Jul 05 02:29:47 devstack cinder-volume[75441]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 02:29:47 devstack cinder-volume[75441]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 02:29:47 devstack cinder-volume[75441]: we strongly recommend against using it for new projects. Jul 05 02:29:47 devstack cinder-volume[75441]: If you are already using Eventlet, we recommend migrating to a different Jul 05 02:29:47 devstack cinder-volume[75441]: framework. For more detail see Jul 05 02:29:47 devstack cinder-volume[75441]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 02:29:47 devstack cinder-volume[75441]: import eventlet # noqa Jul 05 02:29:49 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 02:29:49 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 02:29:49 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 02:29:50 devstack cinder-volume[75441]: INFO dbcounter [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Registered counter for database cinder Jul 05 02:29:50 devstack cinder-volume[75441]: DEBUG oslo_db.sqlalchemy.engines [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:29:51 devstack cinder-volume[75441]: DEBUG dbcounter [-] [75441] Writer thread running {{(pid=75441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 02:29:51 devstack cinder-volume[75441]: INFO cinder.rpc [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 02:29:51 devstack cinder-volume[75441]: INFO cinder.rpc [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 02:29:51 devstack cinder-volume[75441]: DEBUG oslo_db.sqlalchemy.engines [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:29:51 devstack cinder-volume[75441]: INFO cinder.volume.manager [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Determined volume DB was empty at startup. Jul 05 02:29:51 devstack cinder-volume[75441]: DEBUG cinder.volume.manager [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75441) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Jul 05 02:29:51 devstack cinder-volume[75441]: INFO cinder.volume.manager [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 05 02:29:51 devstack cinder-volume[75441]: WARNING stevedore.named [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 02:29:51 devstack cinder-volume[75441]: WARNING castellan.key_manager [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 02:29:51 devstack cinder-volume[75441]: WARNING cinder.keymgr.conf_key_mgr [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 02:29:51 devstack cinder-volume[75441]: DEBUG cinder.volume.drivers.lvm [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75441) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 05 02:29:51 devstack cinder-volume[75441]: DEBUG oslo_concurrency.processutils [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:51 devstack cinder-volume[75441]: DEBUG oslo_concurrency.processutils [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] CMD "cinder-rtstool verify" returned: 0 in 0.494s {{(pid=75441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:51 devstack cinder-volume[75441]: DEBUG oslo_db.sqlalchemy.engines [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:29:51 devstack cinder-volume[75441]: INFO cinder.rpc [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 05 02:29:51 devstack cinder-volume[75441]: INFO cinder.rpc [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Automatically selected cinder-volume RPC version 3.21 as minimum service version. Jul 05 02:29:51 devstack cinder-volume[75441]: WARNING stevedore.named [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 02:29:51 devstack cinder-volume[75441]: WARNING castellan.key_manager [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 02:29:51 devstack cinder-volume[75441]: INFO cinder.volume.manager [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 05 02:29:51 devstack cinder-volume[75441]: DEBUG oslo_db.sqlalchemy.engines [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:29:52 devstack cinder-volume[75441]: INFO oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Starting 1 workers Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Started child 75608 {{(pid=75441) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Full set of CONF: {{(pid=75441) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] ******************************************************************************** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Configuration options gathered from: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] ================================================================================ {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] allow_availability_zone_fallback = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] allow_compression_on_image_upload = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] allowed_direct_url_schemes = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] api_rate_limit = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] auth_strategy = keystone {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] az_cache_duration = 3600 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_availability_zone = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_host = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_stats_polling_interval = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backup_api_class = cinder.backup.api.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backup_name_template = backup-%s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backup_use_same_host = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backup_use_temp_snapshot = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75608]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] chap_password = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] chap_username = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cinder_internal_tenant_project_id = 50346df118724f089cbd5ff355232f42 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cinder_internal_tenant_user_id = 52d0bc4ad9e149e5a003a19cbab47bb8 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cloned_volume_same_az = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cluster = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] compression_format = gzip {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] compute_api_class = cinder.compute.nova.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] config_dir = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] config_source = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] control_exchange = openstack {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] debug = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] default_availability_zone = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] default_group_type = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] default_volume_type = lvmdriver-1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] disk_geometry = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] driver_client_cert = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] driver_client_cert_key = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] driver_data_namespace = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] driver_ssl_cert_path = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] driver_ssl_cert_verify = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] driver_use_ssl = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] enable_force_upload = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] enable_new_services = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] enable_unsupported_driver = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] enabled_backends = ['lvmdriver-1'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] enforce_multipath_for_image_xfer = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] filter_function = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance_api_insecure = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance_api_servers = ['http://192.168.122.216/image'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance_api_ssl_compression = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance_ca_certificates_file = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance_catalog_info = image:glance:publicURL {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance_certfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance_keyfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance_num_retries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance_request_timeout = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] goodness_function = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] graceful_shutdown_timeout = 5 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] group_api_class = cinder.group.api.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] host = devstack {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] image_compress_on_upload = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] image_conversion_address_space_limit = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] image_conversion_cpu_limit = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] image_conversion_disable = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] image_upload_use_cinder_backend = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] image_upload_use_internal_tenant = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] image_volume_cache_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] image_volume_cache_max_count = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] image_volume_cache_max_size_gb = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] init_host_max_objects_retrieval = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] instance_format = [instance: %(uuid)s] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] iscsi_target_flags = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] iscsi_write_cache = on {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] iser_helper = tgtadm {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] iser_ip_address = 192.168.122.216 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] iser_port = 3260 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] log_color = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] log_config_append = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] log_dir = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] log_file = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] log_options = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] log_rotate_interval = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] log_rotate_interval_type = days {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] log_rotation_type = none {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] max_age = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] max_logfile_count = 30 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] max_logfile_size_mb = 200 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] max_over_subscription_ratio = 20.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] message_reap_interval = 86400 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] message_ttl = 2592000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] migration_create_volume_timeout_secs = 300 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] monkey_patch = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] monkey_patch_modules = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] my_ip = 192.168.122.216 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] no_snapshot_gb_quota = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] num_iser_scan_tries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] num_shell_tries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] num_volume_device_scan_tries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] nvmeof_conn_info_version = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] nvmet_ns_id = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] nvmet_port_id = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] osapi_max_limit = 1000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] osapi_volume_ext_list = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] osapi_volume_listen = 0.0.0.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] osapi_volume_listen_port = 8776 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] osapi_volume_use_ssl = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] osapi_volume_workers = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] per_volume_size_limit = -1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] periodic_fuzzy_delay = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] periodic_interval = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] project_id_regex = [0-9a-f\-]+ {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] public_endpoint = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] publish_errors = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] quota_backup_gigabytes = 1000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] quota_backups = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] quota_gigabytes = 1000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] quota_groups = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] quota_snapshots = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] quota_volumes = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] rate_limit_burst = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] rate_limit_except_level = CRITICAL {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] rate_limit_interval = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] reinit_driver_count = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] replication_device = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] report_discard_supported = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] report_interval = 120 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] reservation_clean_interval = 86400 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] reservation_expire = 86400 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] reserved_image_namespaces = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] reserved_percentage = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] rpc_response_timeout = 120 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] run_external_periodic_tasks = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] scst_target_driver = iscsi {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] scst_target_iqn_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_down_time = 720 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] shell_completion = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] snapshot_name_template = snapshot-%s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] snapshot_same_host = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] split_loggers = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] state_path = /opt/stack/data/cinder {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] storage_availability_zone = nova {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] storage_protocol = iSCSI {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] syslog_log_facility = LOG_USER {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] target_helper = lioadm {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] target_ip_address = 192.168.122.216 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] target_port = 3260 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] target_protocol = iscsi {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] target_secondary_ip_addresses = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] trace_flags = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] transfer_api_class = cinder.transfer.api.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] transport_url = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75608]: INFO cinder.volume.manager [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] until_refresh = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] use_chap_auth = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] use_default_quota_class = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] use_journal = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] use_json = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] use_multipath_for_image_xfer = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] use_stderr = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] use_syslog = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] verify_glance_signatures = enabled {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_api_class = cinder.volume.api.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_backend_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_clear = zero {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_clear_ionice = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_clear_size = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_copy_bps_limit = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_dd_blocksize = 1M {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_name_template = volume-%s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_service_inithost_offload = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volume_usage_audit_period = month {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] zoning_mode = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_concurrency.disable_process_locking = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.auth_section = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.auth_type = password {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.auth_version = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.cache = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.certfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.delay_auth_decision = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.http_connect_timeout = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.include_service_catalog = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.insecure = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.interface = public {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.keyfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_password = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcache_username = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.region_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.service_token_roles_required = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.service_type = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.token_cache_time = 300 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.216/identity {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.backend = dogpile.cache.null {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.backend_argument = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.backend_expiration_time = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.config_prefix = cache.oslo {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.debug_cache_backend = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.enable_retry_client = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.enable_socket_keepalive = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.expiration_time = 600 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.hashclient_retry_attempts = 2 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.memcache_dead_retry = 300 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.memcache_pool_maxsize = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.memcache_sasl_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.password = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.proxies = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.redis_db = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.redis_sentinel_service_name = mymaster {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.redis_server = localhost:6379 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.retry_attempts = 2 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.retry_delay = 0.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.socket_keepalive_count = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.socket_keepalive_idle = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.socket_keepalive_interval = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.socket_timeout = 1.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.tls_allowed_ciphers = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.tls_cafile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.tls_certfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.tls_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.tls_keyfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cache.username = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.asyncio_connection = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.asyncio_slave_connection = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.backend = sqlalchemy {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.connection = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.connection_debug = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.connection_parameters = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.connection_recycle_time = 3600 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.connection_trace = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.db_inc_retry_interval = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.db_max_retries = 20 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.db_max_retry_interval = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.db_retry_interval = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.max_overflow = 50 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.max_pool_size = 5 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.max_retries = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.mysql_wsrep_sync_wait = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.pool_timeout = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.retry_interval = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.slave_connection = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.sqlite_synchronous = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.synchronous_reader = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] database.use_db_reconnect = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.connection_string = messaging:// {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.es_doc_type = notification {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.es_scroll_size = 10000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.es_scroll_time = 2m {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.filter_error_trace = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.hmac_keys = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.sentinel_service_name = mymaster {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.socket_timeout = 0.1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.trace_requests = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler.trace_sqlalchemy = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler_jaeger.process_tags = {} {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler_jaeger.service_name_prefix = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] profiler_otlp.service_name_prefix = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.enforce_new_defaults = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.enforce_scope = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.policy_default_rule = default {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.policy_file = policy.yaml {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_policy.remote_timeout = 60.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] coordination.backend_url = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] privsep_osbrick.group = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] privsep_osbrick.helper_command = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] privsep_osbrick.user = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cinder_sys_admin.group = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cinder_sys_admin.helper_command = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack sudo[75613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] cinder_sys_admin.user = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_user.auth_section = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack sudo[75613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_user.auth_type = password {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_user.cafile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_user.certfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_user.collect_timing = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_user.insecure = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_user.keyfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_user.send_service_user_token = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_user.split_loggers = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] service_user.timeout = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance.auth_section = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance.auth_type = password {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance.certfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance.collect_timing = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance.insecure = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance.keyfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance.region_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance.split_loggers = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] glance.timeout = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.backend_availability_zone = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.chap_password = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.chap_username = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.disk_geometry = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.driver_client_cert = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.driver_client_cert_key = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.driver_data_namespace = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.driver_use_ssl = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.enable_unsupported_driver = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.extra_capabilities = {} {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.filter_function = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.goodness_function = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.iscsi_target_flags = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.iscsi_write_cache = on {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.iser_helper = tgtadm {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.iser_ip_address = 192.168.122.216 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.iser_port = 3260 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.lvm_mirrors = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.lvm_share_target = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.lvm_type = auto {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.num_shell_tries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.nvmet_port_id = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.replication_device = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.report_discard_supported = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.reserved_percentage = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.scst_target_driver = iscsi {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.scst_target_iqn_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.storage_protocol = iSCSI {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.target_helper = tgtadm {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.target_ip_address = 192.168.122.216 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.target_port = 3260 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.target_protocol = iscsi {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.trace_flags = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.unique_fqdn_network = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.use_chap_auth = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.volume_backend_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.volume_clear = zero {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.volume_clear_ionice = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.volume_clear_size = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.volume_group = cinder-volumes {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_reports.file_event_handler = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_reports.log_dir = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.backend_availability_zone = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.backend_host = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.chap_password = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.chap_username = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.chiscsi_conf = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.disk_geometry = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.driver_client_cert = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.driver_data_namespace = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.driver_use_ssl = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.extra_capabilities = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.filter_function = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.goodness_function = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.iser_helper = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.iser_ip_address = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.iser_port = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.iser_target_prefix = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.lvm_conf_file = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.lvm_mirrors = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.lvm_share_target = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.lvm_type = auto {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.num_shell_tries = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.nvmet_port_id = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.replication_device = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.report_discard_supported = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.reserved_percentage = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.scst_target_driver = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.storage_protocol = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.target_helper = lioadm {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.target_ip_address = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.target_port = 3260 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.target_protocol = iscsi {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.trace_flags = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.use_chap_auth = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.volume_clear = zero {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.volume_clear_size = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] lvmdriver-1.volumes_dir = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.ssl = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.ssl_version = {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_notifications.driver = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_notifications.retry = -1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] key_manager.fixed_key = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.barbican_api_version = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.barbican_endpoint = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.barbican_endpoint_type = public {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.barbican_region_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.cafile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.certfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.collect_timing = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.insecure = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.keyfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.number_of_retries = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.retry_delay = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.send_service_user_token = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.split_loggers = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.timeout = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.verify_ssl = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican.verify_ssl_path = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican_service_user.auth_section = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican_service_user.auth_type = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican_service_user.cafile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican_service_user.certfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican_service_user.collect_timing = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican_service_user.insecure = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican_service_user.keyfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican_service_user.split_loggers = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] barbican_service_user.timeout = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.approle_role_id = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.approle_secret_id = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.kv_mountpoint = secret {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.kv_path = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.kv_version = 2 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.namespace = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.root_token_id = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.ssl_ca_crt_file = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.timeout = 60.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.use_ssl = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:29:52 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] ******************************************************************************** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 02:29:52 devstack sudo[75613]: pam_unix(sudo:session): session closed for user root Jul 05 02:29:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:52 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:52 devstack sudo[75640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:29:52 devstack sudo[75640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:29:53 devstack sudo[75640]: pam_unix(sudo:session): session closed for user root Jul 05 02:29:53 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.644s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:53 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:29:53 devstack cinder-volume[75608]: INFO cinder.brick.local_dev.lvm [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 05 02:29:53 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:53 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:53 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:53 devstack sudo[75874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 02:29:53 devstack sudo[75874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:29:54 devstack sudo[75874]: pam_unix(sudo:session): session closed for user root Jul 05 02:29:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:54 devstack cinder-volume[75608]: DEBUG cinder.brick.local_dev.lvm [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75608) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 05 02:29:54 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:54 devstack sudo[76075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:29:54 devstack sudo[76075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:29:55 devstack sudo[76075]: pam_unix(sudo:session): session closed for user root Jul 05 02:29:55 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.627s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:55 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:55 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:55 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:55 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:29:55 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:29:56 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Jul 05 02:29:56 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.728s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:56 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:56 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:56 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:56 devstack sudo[76393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 05 02:29:56 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:29:57 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root Jul 05 02:29:57 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.701s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:57 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:57 devstack sudo[76397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 02:29:57 devstack sudo[76397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:29:58 devstack sudo[76397]: pam_unix(sudo:session): session closed for user root Jul 05 02:29:58 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.896s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:58 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:58 devstack sudo[76409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 02:29:58 devstack sudo[76409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:29:59 devstack sudo[76409]: pam_unix(sudo:session): session closed for user root Jul 05 02:29:59 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.828s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:59 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:59 devstack sudo[76414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:29:59 devstack sudo[76414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:29:59 devstack sudo[76414]: pam_unix(sudo:session): session closed for user root Jul 05 02:29:59 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.729s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:29:59 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:29:59 devstack sudo[76419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:29:59 devstack sudo[76419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:00 devstack sudo[76419]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:00 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:00 devstack sudo[76427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:30:00 devstack sudo[76427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:01 devstack sudo[76427]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:01 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:01 devstack cinder-volume[75608]: INFO cinder.volume.drivers.lvm [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 05 02:30:01 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:01 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:01 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:01 devstack sudo[76440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:30:01 devstack sudo[76440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:01 devstack sudo[76440]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:01 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.757s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:01 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 02:30:01 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:01 devstack sudo[76554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 02:30:01 devstack sudo[76554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:02 devstack cinder-volume[75441]: DEBUG dbcounter [-] [75441] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:30:02 devstack sudo[76554]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:02 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:02 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:02 devstack sudo[76685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:30:02 devstack sudo[76685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:03 devstack sudo[76685]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:03 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:03 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:03 devstack sudo[76698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:30:03 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:03 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:03 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:03 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:03 devstack sudo[76702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:30:03 devstack sudo[76702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:04 devstack sudo[76702]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:04 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:04 devstack cinder-volume[75608]: INFO cinder.volume.driver [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 02:30:04 devstack cinder-volume[75608]: DEBUG cinder.volume.driver [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75608) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 02:30:04 devstack cinder-volume[75608]: DEBUG oslo_db.sqlalchemy.engines [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75608) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:30:04 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writer thread running {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 02:30:04 devstack cinder-volume[75608]: DEBUG cinder.db.sqlalchemy.api [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Building query based on filter {{(pid=75608) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jul 05 02:30:04 devstack cinder-volume[75608]: DEBUG cinder.image.image_utils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75608) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 02:30:04 devstack cinder-volume[75608]: INFO cinder.keymgr.migration [None req-a4468949-6329-486d-a3b0-aad351e75a80 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 02:30:04 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 02:30:04 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:04 devstack sudo[76709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 02:30:04 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:05 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:05 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:05 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:05 devstack sudo[76713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:30:05 devstack sudo[76713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:05 devstack sudo[76713]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:05 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:05 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:05 devstack sudo[76719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:30:05 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:06 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:06 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:06 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:06 devstack sudo[76725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:30:06 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:07 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:07 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:07 devstack cinder-volume[75608]: DEBUG cinder.manager [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Notifying Schedulers of capabilities ... {{(pid=75608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:30:07 devstack cinder-volume[75608]: INFO cinder.volume.manager [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Driver initialization completed successfully. Jul 05 02:30:07 devstack cinder-volume[75608]: INFO cinder.manager [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Initiating service 2 cleanup Jul 05 02:30:07 devstack cinder-volume[75608]: INFO cinder.manager [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Service 2 cleanup completed. Jul 05 02:30:07 devstack cinder-volume[75608]: DEBUG cinder.service [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Creating RPC server for service cinder-volume {{(pid=75608) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 02:30:07 devstack cinder-volume[75608]: DEBUG cinder.service [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75608) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 02:30:07 devstack cinder-volume[75608]: INFO cinder.volume.manager [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 05 02:30:07 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 02:30:07 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:07 devstack sudo[76729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 02:30:07 devstack sudo[76729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:08 devstack sudo[76729]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:08 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:08 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:08 devstack sudo[76736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:30:08 devstack sudo[76736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:08 devstack sudo[76736]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:08 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:08 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:08 devstack sudo[76739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:30:08 devstack sudo[76739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:09 devstack sudo[76739]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:09 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:09 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:30:09 devstack sudo[76796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:30:09 devstack sudo[76796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:30:10 devstack sudo[76796]: pam_unix(sudo:session): session closed for user root Jul 05 02:30:10 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:30:10 devstack cinder-volume[75608]: INFO cinder.volume.manager [None req-b590dab8-5f03-407b-990c-fbb9956baf92 None None] Driver post RPC initialization completed successfully. Jul 05 02:30:20 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:30:20 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:30:36 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running periodic task VolumeManager._thread_info {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:30:36 devstack cinder-volume[75608]: DEBUG cinder.volume.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] thread count: 6 {{(pid=75608) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:30:36 devstack cinder-volume[75608]: DEBUG cinder.volume.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] thread info: [<_MainThread(MainThread, started 134015813107840)>, , , , , ] {{(pid=75608) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:31:36 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:31:36 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 02:31:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:31:36 devstack sudo[79121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 02:31:36 devstack sudo[79121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:31:36 devstack sudo[79121]: pam_unix(sudo:session): session closed for user root Jul 05 02:31:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:31:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:31:36 devstack sudo[79124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:31:36 devstack sudo[79124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:31:37 devstack sudo[79124]: pam_unix(sudo:session): session closed for user root Jul 05 02:31:37 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:31:37 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:31:37 devstack sudo[79130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:31:37 devstack sudo[79130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:31:38 devstack sudo[79130]: pam_unix(sudo:session): session closed for user root Jul 05 02:31:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:31:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:31:38 devstack sudo[79318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:31:38 devstack sudo[79318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:31:38 devstack sudo[79318]: pam_unix(sudo:session): session closed for user root Jul 05 02:31:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:31:38 devstack cinder-volume[75608]: DEBUG cinder.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Notifying Schedulers of capabilities ... {{(pid=75608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:31:38 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running periodic task VolumeManager._thread_info {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:31:38 devstack cinder-volume[75608]: DEBUG cinder.volume.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] thread count: 6 {{(pid=75608) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:31:38 devstack cinder-volume[75608]: DEBUG cinder.volume.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] thread info: [<_MainThread(MainThread, started 134015813107840)>, , , , , ] {{(pid=75608) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:32:20 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:32:36 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:32:36 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 02:32:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:32:36 devstack sudo[82772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 02:32:36 devstack sudo[82772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:32:36 devstack sudo[82772]: pam_unix(sudo:session): session closed for user root Jul 05 02:32:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:32:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:32:36 devstack sudo[82825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:32:36 devstack sudo[82825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:32:37 devstack sudo[82825]: pam_unix(sudo:session): session closed for user root Jul 05 02:32:37 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:32:37 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:32:37 devstack sudo[82854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:32:37 devstack sudo[82854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:32:38 devstack sudo[82854]: pam_unix(sudo:session): session closed for user root Jul 05 02:32:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:32:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:32:38 devstack sudo[82875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:32:38 devstack sudo[82875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:32:38 devstack sudo[82875]: pam_unix(sudo:session): session closed for user root Jul 05 02:32:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:32:38 devstack cinder-volume[75608]: DEBUG cinder.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Notifying Schedulers of capabilities ... {{(pid=75608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:32:38 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running periodic task VolumeManager._thread_info {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:32:38 devstack cinder-volume[75608]: DEBUG cinder.volume.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] thread count: 6 {{(pid=75608) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:32:38 devstack cinder-volume[75608]: DEBUG cinder.volume.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] thread info: [<_MainThread(MainThread, started 134015813107840)>, , , , , ] {{(pid=75608) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:33:36 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:33:36 devstack cinder-volume[75608]: DEBUG cinder.volume.drivers.lvm [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Updating volume stats {{(pid=75608) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 02:33:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:33:36 devstack sudo[84466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 02:33:36 devstack sudo[84466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:33:36 devstack sudo[84466]: pam_unix(sudo:session): session closed for user root Jul 05 02:33:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:33:36 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:33:36 devstack sudo[84475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:33:36 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:33:37 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root Jul 05 02:33:37 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:33:37 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:33:37 devstack sudo[84495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 02:33:37 devstack sudo[84495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:33:38 devstack sudo[84495]: pam_unix(sudo:session): session closed for user root Jul 05 02:33:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:33:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:33:38 devstack sudo[84528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 02:33:38 devstack sudo[84528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:33:38 devstack sudo[84528]: pam_unix(sudo:session): session closed for user root Jul 05 02:33:38 devstack cinder-volume[75608]: DEBUG oslo_concurrency.processutils [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75608) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:33:38 devstack cinder-volume[75608]: DEBUG cinder.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Notifying Schedulers of capabilities ... {{(pid=75608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:33:38 devstack cinder-volume[75608]: DEBUG oslo_service.periodic_task [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] Running periodic task VolumeManager._thread_info {{(pid=75608) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:33:38 devstack cinder-volume[75608]: DEBUG cinder.volume.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] thread count: 6 {{(pid=75608) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:33:38 devstack cinder-volume[75608]: DEBUG cinder.volume.manager [None req-3c0170ae-9283-40f1-8f99-22077edefdc1 None None] thread info: [<_MainThread(MainThread, started 134015813107840)>, , , , , ] {{(pid=75608) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:34:20 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writing DB stats cinder:SELECT=1 {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:34:20 devstack cinder-volume[75608]: DEBUG dbcounter [-] [75608] Writing DB stats cinder:UPDATE=1 {{(pid=75608) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:34:30 devstack cinder-volume[75441]: INFO oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Caught SIGTERM, stopping children Jul 05 02:34:30 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Acquiring lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 02:34:30 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Acquired lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 02:34:30 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Releasing lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 02:34:30 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Stop services. {{(pid=75441) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 05 02:34:30 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Killing children. {{(pid=75441) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 05 02:34:30 devstack cinder-volume[75441]: INFO oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Waiting on 1 children to exit Jul 05 02:34:32 devstack cinder-volume[75608]: DEBUG oslo_concurrency.lockutils [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Acquiring lock "singleton_lock" {{(pid=75608) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 02:34:32 devstack cinder-volume[75608]: DEBUG oslo_concurrency.lockutils [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Acquired lock "singleton_lock" {{(pid=75608) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 02:34:32 devstack cinder-volume[75608]: DEBUG oslo_concurrency.lockutils [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Releasing lock "singleton_lock" {{(pid=75608) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 02:34:32 devstack cinder-volume[75608]: WARNING amqp [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 02:34:32 devstack cinder-volume[75608]: WARNING amqp [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 02:34:32 devstack cinder-volume[75441]: INFO oslo_service.backend._eventlet.service [None req-0306ec6f-2953-4492-8a90-1163384b9f7a None None] Child 75608 exited with status 0 Jul 05 02:34:32 devstack cinder-volume[85694]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 02:34:32 devstack cinder-volume[85694]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 02:34:32 devstack cinder-volume[85694]: we strongly recommend against using it for new projects. Jul 05 02:34:32 devstack cinder-volume[85694]: If you are already using Eventlet, we recommend migrating to a different Jul 05 02:34:32 devstack cinder-volume[85694]: framework. For more detail see Jul 05 02:34:32 devstack cinder-volume[85694]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 02:34:32 devstack cinder-volume[85694]: import eventlet # noqa Jul 05 02:34:34 devstack cinder-volume[85694]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85694) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 02:34:34 devstack cinder-volume[85694]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85694) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 02:34:34 devstack cinder-volume[85694]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85694) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 02:34:35 devstack cinder-volume[85694]: INFO dbcounter [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Registered counter for database cinder Jul 05 02:34:35 devstack cinder-volume[85694]: DEBUG oslo_db.sqlalchemy.engines [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85694) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:34:35 devstack cinder-volume[85694]: DEBUG dbcounter [-] [85694] Writer thread running {{(pid=85694) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 02:34:36 devstack cinder-volume[85694]: INFO cinder.rpc [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 02:34:36 devstack cinder-volume[85694]: INFO cinder.rpc [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_db.sqlalchemy.engines [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85694) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:34:36 devstack cinder-volume[85694]: INFO cinder.volume.manager [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Determined volume DB was empty at startup. Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG cinder.volume.manager [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85694) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Jul 05 02:34:36 devstack cinder-volume[85694]: INFO cinder.volume.manager [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 05 02:34:36 devstack cinder-volume[85694]: WARNING stevedore.named [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 02:34:36 devstack cinder-volume[85694]: WARNING castellan.key_manager [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 02:34:36 devstack cinder-volume[85694]: WARNING cinder.keymgr.conf_key_mgr [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 02:34:36 devstack cinder-volume[85694]: INFO cinder.volume.manager [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_db.sqlalchemy.engines [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85694) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:34:36 devstack cinder-volume[85694]: INFO oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Starting 1 workers Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Started child 85910 {{(pid=85694) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Full set of CONF: {{(pid=85694) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] ******************************************************************************** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Configuration options gathered from: {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] ================================================================================ {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] allow_availability_zone_fallback = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] allow_compression_on_image_upload = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] allowed_direct_url_schemes = [] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] api_rate_limit = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] auth_strategy = keystone {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_availability_zone = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_host = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_name = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_stats_polling_interval = 60 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backup_api_class = cinder.backup.api.API {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backup_name_template = backup-%s {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backup_use_same_host = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85910]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backup_use_temp_snapshot = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] chap_password = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] chap_username = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cinder_internal_tenant_project_id = 50346df118724f089cbd5ff355232f42 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cinder_internal_tenant_user_id = 52d0bc4ad9e149e5a003a19cbab47bb8 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cluster = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] compression_format = gzip {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] compute_api_class = cinder.compute.nova.API {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] config_dir = [] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] config_source = [] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] control_exchange = openstack {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] debug = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] default_availability_zone = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] default_group_type = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] default_volume_type = QuobyteHD {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] disk_geometry = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] driver_client_cert = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] driver_client_cert_key = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] driver_data_namespace = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] driver_ssl_cert_path = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] driver_ssl_cert_verify = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] driver_use_ssl = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] enable_new_services = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] enable_unsupported_driver = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] enabled_backends = ['QuobyteHD'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] enforce_multipath_for_image_xfer = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] filter_function = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance_api_insecure = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance_api_servers = ['http://192.168.122.216/image'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance_api_ssl_compression = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance_ca_certificates_file = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance_catalog_info = image:glance:publicURL {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance_certfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance_keyfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance_num_retries = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance_request_timeout = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] goodness_function = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] graceful_shutdown_timeout = 5 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] group_api_class = cinder.group.api.API {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] host = devstack {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] image_compress_on_upload = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] image_conversion_address_space_limit = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] image_conversion_cpu_limit = 60 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] image_conversion_disable = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] image_upload_use_cinder_backend = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] image_upload_use_internal_tenant = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] image_volume_cache_enabled = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] image_volume_cache_max_count = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] image_volume_cache_max_size_gb = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] init_host_max_objects_retrieval = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] instance_format = [instance: %(uuid)s] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] iscsi_target_flags = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] iscsi_write_cache = on {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] iser_helper = tgtadm {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] iser_ip_address = 192.168.122.216 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] iser_port = 3260 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] log_color = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] log_config_append = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] log_dir = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] log_file = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] log_options = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] log_rotate_interval = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] log_rotate_interval_type = days {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] log_rotation_type = none {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] max_age = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] max_logfile_count = 30 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] max_logfile_size_mb = 200 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] max_over_subscription_ratio = 20.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] message_reap_interval = 86400 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] message_ttl = 2592000 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] migration_create_volume_timeout_secs = 300 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] monkey_patch = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] monkey_patch_modules = [] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] my_ip = 192.168.122.216 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] no_snapshot_gb_quota = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] num_iser_scan_tries = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] num_shell_tries = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] num_volume_device_scan_tries = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] nvmeof_conn_info_version = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] nvmet_ns_id = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] nvmet_port_id = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] osapi_max_limit = 1000 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] osapi_volume_ext_list = [] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] osapi_volume_listen = 0.0.0.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] osapi_volume_listen_port = 8776 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] osapi_volume_use_ssl = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] osapi_volume_workers = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] per_volume_size_limit = -1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] periodic_fuzzy_delay = 60 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] periodic_interval = 60 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] project_id_regex = [0-9a-f\-]+ {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] public_endpoint = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] publish_errors = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] quota_backup_gigabytes = 1000 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] quota_backups = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] quota_gigabytes = 1000 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] quota_groups = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] quota_snapshots = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] quota_volumes = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] rate_limit_burst = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] rate_limit_except_level = CRITICAL {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] rate_limit_interval = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] reinit_driver_count = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] replication_device = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] report_discard_supported = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] report_interval = 120 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] reservation_clean_interval = 86400 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] reservation_expire = 86400 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] reserved_image_namespaces = [] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] reserved_percentage = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] rpc_response_timeout = 120 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] run_external_periodic_tasks = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] scst_target_driver = iscsi {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] scst_target_iqn_name = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_down_time = 720 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] shell_completion = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] snapshot_name_template = snapshot-%s {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] split_loggers = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] state_path = /opt/stack/data/cinder {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] storage_availability_zone = nova {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] storage_protocol = iSCSI {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] syslog_log_facility = LOG_USER {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] target_helper = lioadm {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] target_ip_address = 192.168.122.216 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] target_port = 3260 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] target_protocol = iscsi {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] target_secondary_ip_addresses = [] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] trace_flags = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] transfer_api_class = cinder.transfer.api.API {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] transport_url = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] until_refresh = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] use_chap_auth = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] use_default_quota_class = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] use_journal = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] use_json = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] use_multipath_for_image_xfer = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] use_stderr = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] use_syslog = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] verify_glance_signatures = enabled {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_api_class = cinder.volume.api.API {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_backend_name = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_clear = zero {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_clear_ionice = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_clear_size = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_copy_bps_limit = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_dd_blocksize = 1M {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_name_template = volume-%s {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_service_inithost_offload = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volume_usage_audit_period = month {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] zoning_mode = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:36 devstack cinder-volume[85910]: INFO cinder.volume.manager [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 05 02:34:36 devstack cinder-volume[85910]: DEBUG cinder.volume.drivers.remotefs [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85910) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_concurrency.disable_process_locking = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.auth_section = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.auth_type = password {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.auth_version = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.cache = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.certfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.delay_auth_decision = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.http_connect_timeout = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.include_service_catalog = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.insecure = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.interface = public {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.keyfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_password = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcache_username = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.region_name = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.service_token_roles_required = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.service_type = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.token_cache_time = 300 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.216/identity {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.backend = dogpile.cache.null {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.backend_argument = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.backend_expiration_time = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.config_prefix = cache.oslo {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.debug_cache_backend = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.enable_retry_client = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.enable_socket_keepalive = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.enabled = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.expiration_time = 600 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.hashclient_retry_attempts = 2 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.memcache_dead_retry = 300 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.memcache_pool_maxsize = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.memcache_sasl_enabled = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.password = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.proxies = [] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.redis_db = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.redis_sentinel_service_name = mymaster {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.redis_server = localhost:6379 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.retry_attempts = 2 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.retry_delay = 0.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.socket_keepalive_count = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.socket_keepalive_idle = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.socket_keepalive_interval = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.socket_timeout = 1.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.tls_allowed_ciphers = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.tls_cafile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.tls_certfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.tls_enabled = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.tls_keyfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cache.username = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.asyncio_connection = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.asyncio_slave_connection = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.backend = sqlalchemy {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.connection = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.connection_debug = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.connection_parameters = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.connection_recycle_time = 3600 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.connection_trace = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.db_inc_retry_interval = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.db_max_retries = 20 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.db_max_retry_interval = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.db_retry_interval = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.max_overflow = 50 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.max_pool_size = 5 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.max_retries = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.mysql_wsrep_sync_wait = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.pool_timeout = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.retry_interval = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.slave_connection = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.sqlite_synchronous = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.synchronous_reader = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] database.use_db_reconnect = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.connection_string = messaging:// {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.enabled = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.es_doc_type = notification {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.es_scroll_size = 10000 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.es_scroll_time = 2m {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.filter_error_trace = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.hmac_keys = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.sentinel_service_name = mymaster {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.socket_timeout = 0.1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.trace_requests = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler.trace_sqlalchemy = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler_jaeger.process_tags = {} {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler_jaeger.service_name_prefix = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] profiler_otlp.service_name_prefix = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.enforce_new_defaults = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.enforce_scope = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.policy_default_rule = default {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.policy_file = policy.yaml {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_policy.remote_timeout = 60.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] coordination.backend_url = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] privsep_osbrick.group = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] privsep_osbrick.helper_command = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] privsep_osbrick.user = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cinder_sys_admin.group = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cinder_sys_admin.helper_command = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] cinder_sys_admin.user = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_user.auth_section = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_user.auth_type = password {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_user.cafile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_user.certfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_user.collect_timing = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_user.insecure = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_user.keyfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_user.send_service_user_token = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_user.split_loggers = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] service_user.timeout = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance.auth_section = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance.auth_type = password {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance.certfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance.collect_timing = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance.insecure = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance.keyfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance.region_name = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance.split_loggers = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] glance.timeout = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.backend_availability_zone = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.chap_password = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.chap_username = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.disk_geometry = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.driver_client_cert = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.driver_client_cert_key = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.driver_data_namespace = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.driver_use_ssl = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.enable_unsupported_driver = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.extra_capabilities = {} {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.filter_function = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.goodness_function = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.iscsi_target_flags = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.iscsi_write_cache = on {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.iser_helper = tgtadm {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.iser_ip_address = 192.168.122.216 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.iser_port = 3260 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nas_host = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nas_login = admin {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nas_mount_options = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nas_password = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nas_private_key = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nas_share_path = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nas_ssh_port = 22 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.num_shell_tries = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.nvmet_port_id = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.quobyte_client_cfg = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.quobyte_volume_url = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.replication_device = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.report_discard_supported = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.reserved_percentage = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.scst_target_driver = iscsi {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.scst_target_iqn_name = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.storage_protocol = iSCSI {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.target_helper = tgtadm {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.target_ip_address = 192.168.122.216 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.target_port = 3260 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85910]: DEBUG cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85910) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 05 02:34:36 devstack cinder-volume[85910]: WARNING cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 05 02:34:36 devstack cinder-volume[85910]: WARNING cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.target_protocol = iscsi {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Running cmd (subprocess): mount.quobyte {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.trace_flags = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.unique_fqdn_network = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.use_chap_auth = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.volume_backend_name = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.volume_clear = zero {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.volume_clear_ionice = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.volume_clear_size = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_reports.file_event_handler = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_reports.log_dir = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.backend_availability_zone = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.backend_host = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.chap_password = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.chap_username = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.chiscsi_conf = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.disk_geometry = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.driver_client_cert = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.driver_client_cert_key = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.driver_data_namespace = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.driver_use_ssl = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.extra_capabilities = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.filter_function = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.goodness_function = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.iscsi_target_flags = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.iscsi_write_cache = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.iser_helper = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.iser_ip_address = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.iser_port = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.iser_target_prefix = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nas_host = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nas_login = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nas_mount_options = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nas_password = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nas_private_key = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nas_share_path = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nas_ssh_port = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.num_shell_tries = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nvmet_ns_id = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.nvmet_port_id = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.replication_device = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.report_discard_supported = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.reserved_percentage = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.scst_target_driver = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.storage_protocol = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.target_helper = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.target_ip_address = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.target_port = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.target_prefix = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.target_protocol = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.trace_flags = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.unique_fqdn_network = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.use_chap_auth = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.volume_clear = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.volume_clear_ionice = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.volume_clear_size = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] QuobyteHD.volumes_dir = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.ssl = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.ssl_version = {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_notifications.driver = [] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_notifications.retry = -1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] oslo_messaging_notifications.transport_url = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] key_manager.fixed_key = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.barbican_api_version = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.barbican_endpoint = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.barbican_endpoint_type = public {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.barbican_region_name = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.cafile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.certfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.collect_timing = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.insecure = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.keyfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.number_of_retries = 60 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.retry_delay = 1 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.send_service_user_token = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.split_loggers = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.timeout = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.verify_ssl = True {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican.verify_ssl_path = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican_service_user.auth_section = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican_service_user.auth_type = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican_service_user.cafile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican_service_user.certfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican_service_user.collect_timing = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican_service_user.insecure = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican_service_user.keyfile = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican_service_user.split_loggers = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] barbican_service_user.timeout = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.approle_role_id = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.approle_secret_id = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.kv_mountpoint = secret {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.kv_path = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.kv_version = 2 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.namespace = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.root_token_id = **** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.ssl_ca_crt_file = None {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.timeout = 60.0 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.use_ssl = False {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:36 devstack quobyte-client[85915]: Reading configuration file: /etc/quobyte/client.cfg Jul 05 02:34:36 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] ******************************************************************************** {{(pid=85694) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 02:34:36 devstack quobyte-client[85915]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 05 02:34:36 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:34:36 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:34:36 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:34:36 devstack cinder-volume[85910]: DEBUG cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=85910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:34:36 devstack cinder-volume[85910]: INFO cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e ... Jul 05 02:34:36 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a -c /etc/quobyte/client-cinder.cfg {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:34:36 devstack sudo[85916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a -c /etc/quobyte/client-cinder.cfg Jul 05 02:34:36 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:34:37 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root Jul 05 02:34:37 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.782s {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:34:37 devstack cinder-volume[85910]: INFO cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e succeeded Jul 05 02:34:37 devstack cinder-volume[85910]: DEBUG cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=85910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:34:37 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.792s {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:34:37 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:34:37 devstack sudo[85985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:34:37 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:34:38 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.608s {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:34:38 devstack cinder-volume[85910]: INFO cinder.volume.driver [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG cinder.volume.driver [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85910) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG oslo_db.sqlalchemy.engines [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG dbcounter [-] [85910] Writer thread running {{(pid=85910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG cinder.db.sqlalchemy.api [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Building query based on filter {{(pid=85910) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG cinder.image.image_utils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85910) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 02:34:38 devstack cinder-volume[85910]: INFO cinder.keymgr.migration [None req-703c0443-db0d-4785-92ae-3c49194dc3ad None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=85910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=85910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:34:38 devstack sudo[85988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:34:38 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:34:38 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.673s {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG cinder.manager [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Notifying Schedulers of capabilities ... {{(pid=85910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:34:38 devstack cinder-volume[85910]: INFO cinder.volume.manager [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Driver initialization completed successfully. Jul 05 02:34:38 devstack cinder-volume[85910]: INFO cinder.manager [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Initiating service 3 cleanup Jul 05 02:34:38 devstack cinder-volume[85910]: INFO cinder.manager [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Service 3 cleanup completed. Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG cinder.service [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Creating RPC server for service cinder-volume {{(pid=85910) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 02:34:38 devstack cinder-volume[85910]: DEBUG cinder.service [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85910) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 02:34:39 devstack cinder-volume[85910]: INFO cinder.volume.manager [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 05 02:34:39 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:34:39 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:34:39 devstack cinder-volume[85910]: DEBUG cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=85910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:34:39 devstack cinder-volume[85910]: DEBUG cinder.volume.drivers.quobyte [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=85910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:34:39 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:34:39 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:34:39 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:34:39 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:34:39 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Jul 05 02:34:39 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.760s {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:34:39 devstack cinder-volume[85910]: INFO cinder.volume.manager [None req-6362e031-f53e-40b6-bdf5-9642bdbf99f8 None None] Driver post RPC initialization completed successfully. Jul 05 02:34:44 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-3ae1e72b-ee06-45ae-abf2-93eaa6a95dc2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:34:44 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-3ae1e72b-ee06-45ae-abf2-93eaa6a95dc2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:34:44 devstack cinder-volume[85910]: DEBUG cinder.volume.drivers.quobyte [None req-3ae1e72b-ee06-45ae-abf2-93eaa6a95dc2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=85910) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:34:44 devstack cinder-volume[85910]: DEBUG cinder.volume.drivers.quobyte [None req-3ae1e72b-ee06-45ae-abf2-93eaa6a95dc2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=85910) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:34:44 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-3ae1e72b-ee06-45ae-abf2-93eaa6a95dc2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85910) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:34:44 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-3ae1e72b-ee06-45ae-abf2-93eaa6a95dc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:34:44 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:34:44 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:34:44 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Jul 05 02:34:44 devstack cinder-volume[85910]: DEBUG oslo_concurrency.processutils [None req-3ae1e72b-ee06-45ae-abf2-93eaa6a95dc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.626s {{(pid=85910) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:34:44 devstack cinder-volume[85910]: DEBUG cinder.manager [None req-3ae1e72b-ee06-45ae-abf2-93eaa6a95dc2 None None] Notifying Schedulers of capabilities ... {{(pid=85910) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:34:46 devstack cinder-volume[85694]: INFO oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Caught SIGTERM, stopping children Jul 05 02:34:46 devstack cinder-volume[85694]: DEBUG oslo_concurrency.lockutils [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Acquiring lock "singleton_lock" {{(pid=85694) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 02:34:46 devstack cinder-volume[85694]: DEBUG oslo_concurrency.lockutils [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Acquired lock "singleton_lock" {{(pid=85694) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 02:34:46 devstack cinder-volume[85694]: DEBUG oslo_concurrency.lockutils [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Releasing lock "singleton_lock" {{(pid=85694) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 02:34:46 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Stop services. {{(pid=85694) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 05 02:34:46 devstack cinder-volume[85694]: DEBUG oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Killing children. {{(pid=85694) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 05 02:34:46 devstack cinder-volume[85694]: INFO oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Waiting on 1 children to exit Jul 05 02:34:47 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Acquiring lock "singleton_lock" {{(pid=85910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 02:34:47 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Acquired lock "singleton_lock" {{(pid=85910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 02:34:47 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Releasing lock "singleton_lock" {{(pid=85910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 02:34:47 devstack cinder-volume[85910]: WARNING amqp [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 02:34:47 devstack cinder-volume[85910]: WARNING amqp [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 02:34:47 devstack cinder-volume[85694]: INFO oslo_service.backend._eventlet.service [None req-16eccc63-369c-4c9d-8bb9-1024b0d7369c None None] Child 85910 exited with status 0 Jul 05 02:34:47 devstack cinder-volume[86365]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 02:34:47 devstack cinder-volume[86365]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 02:34:47 devstack cinder-volume[86365]: we strongly recommend against using it for new projects. Jul 05 02:34:47 devstack cinder-volume[86365]: If you are already using Eventlet, we recommend migrating to a different Jul 05 02:34:47 devstack cinder-volume[86365]: framework. For more detail see Jul 05 02:34:47 devstack cinder-volume[86365]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 02:34:47 devstack cinder-volume[86365]: import eventlet # noqa Jul 05 02:34:50 devstack cinder-volume[86365]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 02:34:50 devstack cinder-volume[86365]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 02:34:50 devstack cinder-volume[86365]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 02:34:51 devstack cinder-volume[86365]: INFO dbcounter [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Registered counter for database cinder Jul 05 02:34:51 devstack cinder-volume[86365]: DEBUG oslo_db.sqlalchemy.engines [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86365) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG dbcounter [-] [86365] Writer thread running {{(pid=86365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 02:34:52 devstack cinder-volume[86365]: INFO cinder.rpc [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 02:34:52 devstack cinder-volume[86365]: INFO cinder.rpc [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_db.sqlalchemy.engines [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86365) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:34:52 devstack cinder-volume[86365]: INFO cinder.volume.manager [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Determined volume DB was empty at startup. Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG cinder.volume.manager [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86365) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Jul 05 02:34:52 devstack cinder-volume[86365]: WARNING stevedore.named [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 02:34:52 devstack cinder-volume[86365]: WARNING castellan.key_manager [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 02:34:52 devstack cinder-volume[86365]: WARNING cinder.keymgr.conf_key_mgr [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 02:34:52 devstack cinder-volume[86365]: INFO cinder.volume.manager [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_db.sqlalchemy.engines [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86365) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:34:52 devstack cinder-volume[86365]: INFO oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Starting 1 workers Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Started child 86671 {{(pid=86365) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Full set of CONF: {{(pid=86365) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] ******************************************************************************** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] Configuration options gathered from: {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] ================================================================================ {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] allow_availability_zone_fallback = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] allow_compression_on_image_upload = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] allowed_direct_url_schemes = [] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] api_rate_limit = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] auth_strategy = keystone {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_availability_zone = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_host = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_name = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_stats_polling_interval = 60 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backup_api_class = cinder.backup.api.API {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backup_name_template = backup-%s {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backup_use_same_host = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backup_use_temp_snapshot = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86671]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] chap_password = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] chap_username = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cinder_internal_tenant_project_id = 50346df118724f089cbd5ff355232f42 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cinder_internal_tenant_user_id = 52d0bc4ad9e149e5a003a19cbab47bb8 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cluster = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] compression_format = gzip {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] compute_api_class = cinder.compute.nova.API {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] config_dir = [] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] config_source = [] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] control_exchange = openstack {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] debug = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] default_availability_zone = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] default_group_type = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] default_volume_type = QuobyteHD {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] disk_geometry = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] driver_client_cert = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] driver_client_cert_key = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] driver_data_namespace = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] driver_ssl_cert_path = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] driver_ssl_cert_verify = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] driver_use_ssl = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] enable_new_services = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] enable_unsupported_driver = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] enabled_backends = ['QuobyteHD'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] enforce_multipath_for_image_xfer = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] filter_function = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance_api_insecure = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance_api_servers = ['http://192.168.122.216/image'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance_api_ssl_compression = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance_ca_certificates_file = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance_catalog_info = image:glance:publicURL {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance_certfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance_keyfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance_num_retries = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance_request_timeout = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] goodness_function = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] graceful_shutdown_timeout = 5 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] group_api_class = cinder.group.api.API {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] host = devstack {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] image_compress_on_upload = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] image_conversion_address_space_limit = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] image_conversion_cpu_limit = 60 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] image_conversion_disable = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] image_upload_use_cinder_backend = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] image_upload_use_internal_tenant = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] image_volume_cache_enabled = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] image_volume_cache_max_count = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] image_volume_cache_max_size_gb = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] init_host_max_objects_retrieval = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] instance_format = [instance: %(uuid)s] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] iscsi_target_flags = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] iscsi_write_cache = on {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] iser_helper = tgtadm {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] iser_ip_address = 192.168.122.216 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] iser_port = 3260 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] log_color = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] log_config_append = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] log_dir = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] log_file = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] log_options = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] log_rotate_interval = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Starting volume driver QuobyteDriver (1.1.14) Jul 05 02:34:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86671) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] log_rotate_interval_type = days {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] log_rotation_type = none {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] max_age = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] max_logfile_count = 30 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] max_logfile_size_mb = 200 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] max_over_subscription_ratio = 20.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] message_reap_interval = 86400 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] message_ttl = 2592000 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] migration_create_volume_timeout_secs = 300 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] monkey_patch = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] monkey_patch_modules = [] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] my_ip = 192.168.122.216 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] no_snapshot_gb_quota = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] num_iser_scan_tries = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] num_shell_tries = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] num_volume_device_scan_tries = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] nvmeof_conn_info_version = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] nvmet_ns_id = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] nvmet_port_id = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] osapi_max_limit = 1000 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] osapi_volume_ext_list = [] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] osapi_volume_listen_port = 8776 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] osapi_volume_use_ssl = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] osapi_volume_workers = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] per_volume_size_limit = -1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] periodic_fuzzy_delay = 60 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] periodic_interval = 60 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] public_endpoint = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] publish_errors = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] quota_backup_gigabytes = 1000 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] quota_backups = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] quota_gigabytes = 1000 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] quota_groups = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] quota_snapshots = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] quota_volumes = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] rate_limit_burst = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] rate_limit_except_level = CRITICAL {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] rate_limit_interval = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] reinit_driver_count = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] replication_device = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] report_discard_supported = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] report_interval = 120 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] reservation_clean_interval = 86400 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] reservation_expire = 86400 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] reserved_image_namespaces = [] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] reserved_percentage = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] rpc_response_timeout = 120 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] run_external_periodic_tasks = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] scst_target_driver = iscsi {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] scst_target_iqn_name = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_down_time = 720 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] shell_completion = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] snapshot_name_template = snapshot-%s {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] split_loggers = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] state_path = /opt/stack/data/cinder {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] storage_availability_zone = nova {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] storage_protocol = iSCSI {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] syslog_log_facility = LOG_USER {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] target_helper = lioadm {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] target_ip_address = 192.168.122.216 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] target_port = 3260 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] target_protocol = iscsi {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] target_secondary_ip_addresses = [] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] trace_flags = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] transport_url = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] until_refresh = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] use_chap_auth = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] use_default_quota_class = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] use_journal = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] use_json = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] use_multipath_for_image_xfer = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] use_stderr = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] use_syslog = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] verify_glance_signatures = enabled {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_api_class = cinder.volume.api.API {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_backend_name = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_clear = zero {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_clear_ionice = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_clear_size = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_copy_bps_limit = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_dd_blocksize = 1M {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_name_template = volume-%s {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_service_inithost_offload = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volume_usage_audit_period = month {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] zoning_mode = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_concurrency.disable_process_locking = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.auth_section = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.auth_type = password {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.auth_version = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.cache = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.certfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.include_service_catalog = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.insecure = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.interface = public {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.keyfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_password = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcache_username = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.region_name = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.service_type = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.216/identity {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.backend = dogpile.cache.null {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.backend_argument = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.backend_expiration_time = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.config_prefix = cache.oslo {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.debug_cache_backend = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.enable_retry_client = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.enable_socket_keepalive = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.enabled = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.expiration_time = 600 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.hashclient_retry_attempts = 2 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.memcache_dead_retry = 300 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.memcache_pool_maxsize = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack quobyte-client[86682]: Reading configuration file: /etc/quobyte/client.cfg Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.memcache_sasl_enabled = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.password = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.proxies = [] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.redis_db = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack quobyte-client[86682]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.redis_server = localhost:6379 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.retry_attempts = 2 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.retry_delay = 0.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.socket_keepalive_count = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.socket_keepalive_idle = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.socket_keepalive_interval = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.socket_timeout = 1.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.tls_allowed_ciphers = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.tls_cafile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.tls_certfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.tls_enabled = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.tls_keyfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cache.username = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.asyncio_connection = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.asyncio_slave_connection = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.backend = sqlalchemy {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.connection = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.connection_debug = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.connection_parameters = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.connection_recycle_time = 3600 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.connection_trace = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.db_inc_retry_interval = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.db_max_retries = 20 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.db_max_retry_interval = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.db_retry_interval = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.max_overflow = 50 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.max_pool_size = 5 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.max_retries = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.mysql_wsrep_sync_wait = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.pool_timeout = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.retry_interval = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.slave_connection = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.sqlite_synchronous = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.synchronous_reader = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] database.use_db_reconnect = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.connection_string = messaging:// {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.enabled = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.es_doc_type = notification {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.es_scroll_size = 10000 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.es_scroll_time = 2m {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.filter_error_trace = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.hmac_keys = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.sentinel_service_name = mymaster {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86671) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 05 02:34:52 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.quobyte [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 05 02:34:52 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.quobyte [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.socket_timeout = 0.1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.trace_requests = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler.trace_sqlalchemy = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler_jaeger.process_tags = {} {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler_jaeger.service_name_prefix = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] profiler_otlp.service_name_prefix = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.enforce_new_defaults = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.enforce_scope = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.policy_default_rule = default {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.policy_file = policy.yaml {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:52 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Running cmd (subprocess): mount.quobyte {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] coordination.backend_url = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] privsep_osbrick.group = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] privsep_osbrick.helper_command = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] privsep_osbrick.user = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cinder_sys_admin.group = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cinder_sys_admin.helper_command = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] cinder_sys_admin.user = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_user.auth_section = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_user.auth_type = password {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_user.cafile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_user.certfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_user.collect_timing = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_user.insecure = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_user.keyfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_user.send_service_user_token = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_user.split_loggers = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] service_user.timeout = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance.auth_section = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance.auth_type = password {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance.certfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance.collect_timing = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance.insecure = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance.keyfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance.region_name = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance.split_loggers = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] glance.timeout = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.backend_availability_zone = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.chap_password = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.chap_username = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.disk_geometry = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.driver_client_cert = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.driver_client_cert_key = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.driver_data_namespace = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.driver_use_ssl = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.extra_capabilities = {} {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.filter_function = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.goodness_function = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.iscsi_target_flags = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.iscsi_write_cache = on {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.iser_helper = tgtadm {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.iser_ip_address = 192.168.122.216 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.iser_port = 3260 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nas_host = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nas_login = admin {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nas_mount_options = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nas_password = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nas_private_key = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nas_share_path = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.num_shell_tries = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.quobyte_volume_url = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.replication_device = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.report_discard_supported = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.reserved_percentage = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.target_helper = tgtadm {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.target_ip_address = 192.168.122.216 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.target_port = 3260 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.target_protocol = iscsi {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.trace_flags = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.unique_fqdn_network = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.use_chap_auth = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.volume_backend_name = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.volume_clear = zero {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.volume_clear_ionice = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.volume_clear_size = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_reports.file_event_handler = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_reports.log_dir = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.backend_availability_zone = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.backend_host = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.chap_password = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.chap_username = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.chiscsi_conf = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.disk_geometry = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.driver_client_cert = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.driver_data_namespace = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.driver_use_ssl = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.extra_capabilities = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.filter_function = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.goodness_function = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.iser_helper = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.iser_ip_address = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.iser_port = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.iser_target_prefix = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nas_host = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nas_login = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nas_mount_options = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nas_password = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nas_private_key = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nas_share_path = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nas_ssh_port = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.num_shell_tries = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.nvmet_port_id = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.replication_device = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.report_discard_supported = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.reserved_percentage = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.scst_target_driver = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.storage_protocol = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.target_helper = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.target_ip_address = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.target_port = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.target_prefix = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.target_protocol = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.trace_flags = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.use_chap_auth = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.volume_clear = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.volume_clear_size = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] QuobyteHD.volumes_dir = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] CMD "mount.quobyte" returned: 1 in 0.183s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:34:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.ssl = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_notifications.driver = [] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_notifications.retry = -1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] key_manager.fixed_key = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.barbican_api_version = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.barbican_endpoint = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.barbican_endpoint_type = public {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.barbican_region_name = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.cafile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.certfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.collect_timing = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.insecure = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.keyfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.number_of_retries = 60 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.retry_delay = 1 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.send_service_user_token = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.split_loggers = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.timeout = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.verify_ssl = True {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican.verify_ssl_path = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican_service_user.auth_section = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican_service_user.auth_type = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican_service_user.cafile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican_service_user.certfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican_service_user.collect_timing = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican_service_user.insecure = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican_service_user.keyfile = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican_service_user.split_loggers = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] barbican_service_user.timeout = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.approle_role_id = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.approle_secret_id = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.kv_mountpoint = secret {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.kv_path = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.kv_version = 2 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.namespace = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.root_token_id = **** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.ssl_ca_crt_file = None {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.timeout = 60.0 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.use_ssl = False {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 02:34:53 devstack cinder-volume[86365]: DEBUG oslo_service.backend._eventlet.service [None req-d537dbf2-1895-4f26-93ba-73f7bd7fdb5c None None] ******************************************************************************** {{(pid=86365) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 02:34:54 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.421s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:34:54 devstack cinder-volume[86671]: INFO cinder.volume.driver [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Driver hasn't implemented _init_vendor_properties() Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG cinder.volume.driver [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86671) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG oslo_db.sqlalchemy.engines [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86671) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writer thread running {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG cinder.db.sqlalchemy.api [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Building query based on filter {{(pid=86671) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86671) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:34:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:34:54 devstack cinder-volume[86671]: INFO cinder.keymgr.migration [None req-b0654de3-6b47-468b-a09b-7d509997ed74 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 02:34:54 devstack sudo[86694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:34:54 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:34:55 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root Jul 05 02:34:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.639s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:34:55 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:34:55 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Driver initialization completed successfully. Jul 05 02:34:55 devstack cinder-volume[86671]: INFO cinder.manager [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Initiating service 3 cleanup Jul 05 02:34:55 devstack cinder-volume[86671]: INFO cinder.manager [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Service 3 cleanup completed. Jul 05 02:34:55 devstack cinder-volume[86671]: DEBUG cinder.service [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Creating RPC server for service cinder-volume {{(pid=86671) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 02:34:55 devstack cinder-volume[86671]: DEBUG cinder.service [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86671) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 02:34:55 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 05 02:34:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:34:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:34:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:34:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:34:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:34:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:34:55 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:34:55 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:34:56 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Jul 05 02:34:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.664s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:34:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-32c1ec09-10a5-4376-83b2-55676ffd3b3b None None] Driver post RPC initialization completed successfully. Jul 05 02:35:02 devstack cinder-volume[86365]: DEBUG dbcounter [-] [86365] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:35:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:35:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 6 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:35:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:35:05 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:35:06 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=3 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:35:55 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:35:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Flow 'volume_create_manager' (29fd94bc-64f3-40be-b0fa-36a7f043a2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:35:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab13c58b-929c-41cc-b0bc-978daccf4ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab13c58b-929c-41cc-b0bc-978daccf4ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1397711279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36069d63-7254-4307-bba6-fa9195e7c70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a1c57660a44b54bc0727cc68118685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:35:56Z,use_quota=True,user_id='1e5539b16cab4d79a932866de68ddc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c103b2be-8f95-4acc-9a52-c443f27365f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c103b2be-8f95-4acc-9a52-c443f27365f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f00183-659a-460e-a408-3a11cc1aacc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f00183-659a-460e-a408-3a11cc1aacc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36069d63-7254-4307-bba6-fa9195e7c70f', 'volume_name': 'volume-36069d63-7254-4307-bba6-fa9195e7c70f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f1cdad-482f-4fca-a611-a97308019cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f1cdad-482f-4fca-a611-a97308019cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364fe7f6-ef93-4299-91ea-f106be978727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:35:56 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Volume 36069d63-7254-4307-bba6-fa9195e7c70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36069d63-7254-4307-bba6-fa9195e7c70f', 'volume_size': 1} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1397711279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36069d63-7254-4307-bba6-fa9195e7c70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6a1c57660a44b54bc0727cc68118685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:35:56Z,use_quota=True,user_id='1e5539b16cab4d79a932866de68ddc1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Creating volume 36069d63-7254-4307-bba6-fa9195e7c70f {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:35:56 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:35:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:35:56 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f 1073741824 Jul 05 02:35:56 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:35:57 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Jul 05 02:35:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f 1073741824" returned: 0 in 1.193s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:35:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:35:57 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f Jul 05 02:35:57 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:35:58 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Jul 05 02:35:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f" returned: 0 in 0.704s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:35:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:35:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:35:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364fe7f6-ef93-4299-91ea-f106be978727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36069d63-7254-4307-bba6-fa9195e7c70f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:35:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157cac08-f121-4fb4-b052-836f912e6122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:35:58 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Volume volume-36069d63-7254-4307-bba6-fa9195e7c70f (36069d63-7254-4307-bba6-fa9195e7c70f): created successfully Jul 05 02:35:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157cac08-f121-4fb4-b052-836f912e6122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:35:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Flow 'volume_create_manager' (29fd94bc-64f3-40be-b0fa-36a7f043a2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:35:58 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-30dfe9b7-d936-426b-a5f1-59409e349dbc tempest-TaggedAttachmentsTest-795961039 None] Created volume successfully. Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:36:05 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:36:05 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:36:05 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.732s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 6 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:36:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:36:08 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:36:08 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Flow 'volume_create_manager' (708eb941-f408-40de-bc99-fe7d6df9b847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d04309-e337-4d93-b5e4-b965bb5da68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d04309-e337-4d93-b5e4-b965bb5da68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1453257404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649e3de8-257a-4704-8d6d-b9bdc593aaf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8697764bd3e44006b0cc6faaf4fea939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:36:24Z,use_quota=True,user_id='10da389ce7394fd99ea7da2969580669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695a0205-fdaf-4a2a-8656-a8500c060ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695a0205-fdaf-4a2a-8656-a8500c060ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271a2ad9-ee67-4284-ba1f-27b1434e279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271a2ad9-ee67-4284-ba1f-27b1434e279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649e3de8-257a-4704-8d6d-b9bdc593aaf4', 'volume_name': 'volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2143e8-89f3-4b78-bd79-e5186d7b0a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2143e8-89f3-4b78-bd79-e5186d7b0a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa036c9-821c-459f-84a2-43728b0ee5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:23 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Volume 649e3de8-257a-4704-8d6d-b9bdc593aaf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4', 'volume_size': 1} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1453257404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649e3de8-257a-4704-8d6d-b9bdc593aaf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8697764bd3e44006b0cc6faaf4fea939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:36:24Z,use_quota=True,user_id='10da389ce7394fd99ea7da2969580669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Creating volume 649e3de8-257a-4704-8d6d-b9bdc593aaf4 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:36:23 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:36:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:36:23 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4 1073741824 Jul 05 02:36:23 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:36:25 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Jul 05 02:36:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4 1073741824" returned: 0 in 1.747s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:36:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:36:25 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4 Jul 05 02:36:25 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:36:27 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Jul 05 02:36:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4" returned: 0 in 2.099s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:36:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] <== create_volume: return (3951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:36:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.959s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:36:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa036c9-821c-459f-84a2-43728b0ee5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f4bac1-ff7d-4b6d-a3a4-c9c51915e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:27 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Volume volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4 (649e3de8-257a-4704-8d6d-b9bdc593aaf4): created successfully Jul 05 02:36:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f4bac1-ff7d-4b6d-a3a4-c9c51915e47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Flow 'volume_create_manager' (708eb941-f408-40de-bc99-fe7d6df9b847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:36:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-77be2f3d-0b8c-4759-b142-8398e4527b92 tempest-VolumesAdminNegativeTest-246482256 None] Created volume successfully. Jul 05 02:36:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Acquiring lock "cinder-649e3de8-257a-4704-8d6d-b9bdc593aaf4-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:36:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Lock "cinder-649e3de8-257a-4704-8d6d-b9bdc593aaf4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:36:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Acquiring lock "cinder-quobyte-649e3de8-257a-4704-8d6d-b9bdc593aaf4" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:36:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Lock "cinder-quobyte-649e3de8-257a-4704-8d6d-b9bdc593aaf4" acquired by "delete_volume" :: waited 0.039s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:36:29 devstack cinder-volume[86671]: INFO oslo.privsep.daemon [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpl7pggpal/privsep.sock'] Jul 05 02:36:29 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpl7pggpal/privsep.sock Jul 05 02:36:29 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:36:30 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 05 02:36:30 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 02:36:30 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 02:36:30 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 02:36:30 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 02:36:30 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 02:36:30 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 02:36:30 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 02:36:30 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 05 02:36:31 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 05 02:36:31 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 02:36:31 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 02:36:31 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 02:36:31 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 02:36:31 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 02:36:31 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 02:36:31 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 02:36:31 devstack cinder-volume[86671]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 05 02:36:32 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Jul 05 02:36:32 devstack cinder-volume[86671]: INFO oslo.privsep.daemon [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Spawned new privsep daemon via rootwrap Jul 05 02:36:32 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Accepted privsep connection to /tmp/tmpl7pggpal/privsep.sock {{(pid=86671) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 05 02:36:32 devstack cinder-volume[86671]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 05 02:36:32 devstack cinder-volume[86671]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 05 02:36:32 devstack cinder-volume[86671]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 05 02:36:32 devstack cinder-volume[86671]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87648 Jul 05 02:36:32 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[693b4ebe-d910-4942-a92c-f8523da26cc1]: (2,) {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:36:32 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0939de6b-6534-48b9-a920-fe4718ca353a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:36:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:36:32 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4 Jul 05 02:36:32 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:36:34 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Jul 05 02:36:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4" returned: 0 in 1.931s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:36:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:36:34 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4 Jul 05 02:36:34 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:36:35 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Jul 05 02:36:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-649e3de8-257a-4704-8d6d-b9bdc593aaf4" returned: 0 in 0.937s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:36:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Lock "cinder-quobyte-649e3de8-257a-4704-8d6d-b9bdc593aaf4" released by "delete_volume" :: held 5.824s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:36:35 devstack cinder-volume[86671]: WARNING cinder.quota [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:36:35 devstack cinder-volume[86671]: WARNING cinder.quota [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:36:35 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Created reservations ['5e583d22-d226-4f7f-9a44-0e0db70413c4', '5a359364-386a-4680-b368-f11cacb02023', 'c03ab692-7663-41fa-8d17-8beb8afb84b0', '361c6ec5-d0e5-4a59-8136-48e74d0b221d'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:36:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:36:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:36:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:36:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:36:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:36:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:36:35 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:36:35 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:36:36 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Jul 05 02:36:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.046s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:36:36 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:36:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Deleted volume successfully. Jul 05 02:36:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3d6eb3d-d480-491d-b64c-abf9a3f7dd45 tempest-VolumesAdminNegativeTest-246482256 None] Lock "cinder-649e3de8-257a-4704-8d6d-b9bdc593aaf4-delete_volume" released by "delete_volume" :: held 7.340s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:36:45 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=12,cinder:SELECT=10,cinder:INSERT=4 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:36:46 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=4,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Flow 'volume_create_manager' (ba2e7e91-377f-441f-806a-29e034c9e5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50ac5e6-7d9f-43f0-936f-8d171952cdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50ac5e6-7d9f-43f0-936f-8d171952cdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1878567458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1be7f49-083f-49bf-a36d-e1905c51cb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bb2301f2fd4ae9858497946070c6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:36:52Z,use_quota=True,user_id='742eda10e9f2453a8d01970133fb0902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236e926a-24ed-418c-abe1-fa9f07224336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236e926a-24ed-418c-abe1-fa9f07224336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029c8bed-ae42-4ef5-8038-a04a94872cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029c8bed-ae42-4ef5-8038-a04a94872cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1be7f49-083f-49bf-a36d-e1905c51cb90', 'volume_name': 'volume-d1be7f49-083f-49bf-a36d-e1905c51cb90', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e359cb5-556e-42b0-b904-a996c29ea60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e359cb5-556e-42b0-b904-a996c29ea60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bada39-a06c-4f83-a520-c2b3e57dcd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:51 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Volume d1be7f49-083f-49bf-a36d-e1905c51cb90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1be7f49-083f-49bf-a36d-e1905c51cb90', 'volume_size': 1} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1878567458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1be7f49-083f-49bf-a36d-e1905c51cb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bb2301f2fd4ae9858497946070c6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:36:52Z,use_quota=True,user_id='742eda10e9f2453a8d01970133fb0902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Creating volume d1be7f49-083f-49bf-a36d-e1905c51cb90 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:36:51 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:36:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:36:51 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 1073741824 Jul 05 02:36:51 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:36:53 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Jul 05 02:36:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 1073741824" returned: 0 in 1.359s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:36:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:36:53 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 Jul 05 02:36:53 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:36:54 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Jul 05 02:36:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90" returned: 0 in 0.763s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:36:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:36:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:36:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bada39-a06c-4f83-a520-c2b3e57dcd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1be7f49-083f-49bf-a36d-e1905c51cb90', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c65ba21-9489-492a-a414-34d71dacb2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:36:54 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Volume volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 (d1be7f49-083f-49bf-a36d-e1905c51cb90): created successfully Jul 05 02:36:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c65ba21-9489-492a-a414-34d71dacb2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:36:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Flow 'volume_create_manager' (ba2e7e91-377f-441f-806a-29e034c9e5e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:36:54 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e3d99032-6ff9-44fc-80c3-f3798b13074b tempest-ServerActionsTestOtherA-1706528703 None] Created volume successfully. Jul 05 02:37:04 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:37:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:37:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:37:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:37:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:05 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:37:05 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:06 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:37:06 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.464s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:37:17 devstack cinder-volume[86671]: WARNING py.warnings [req-59a21313-f61f-4ac0-9f31-dbb4ca4230b0 req-f58a9f7a-2f0f-413a-a1a2-86afcdab1a70 tempest-TaggedAttachmentsTest-795961039 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 05 02:37:17 devstack cinder-volume[86671]: .first() Jul 05 02:37:17 devstack cinder-volume[86671]: Jul 05 02:37:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-59a21313-f61f-4ac0-9f31-dbb4ca4230b0 req-f58a9f7a-2f0f-413a-a1a2-86afcdab1a70 tempest-TaggedAttachmentsTest-795961039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-59a21313-f61f-4ac0-9f31-dbb4ca4230b0 req-f58a9f7a-2f0f-413a-a1a2-86afcdab1a70 tempest-TaggedAttachmentsTest-795961039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:17 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc370d01-3e82-46cd-ae20-df9ce88e532d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:37:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-59a21313-f61f-4ac0-9f31-dbb4ca4230b0 req-f58a9f7a-2f0f-413a-a1a2-86afcdab1a70 tempest-TaggedAttachmentsTest-795961039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:17 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f Jul 05 02:37:17 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:18 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-59a21313-f61f-4ac0-9f31-dbb4ca4230b0 req-f58a9f7a-2f0f-413a-a1a2-86afcdab1a70 tempest-TaggedAttachmentsTest-795961039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f" returned: 0 in 1.084s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-59a21313-f61f-4ac0-9f31-dbb4ca4230b0 req-f58a9f7a-2f0f-413a-a1a2-86afcdab1a70 tempest-TaggedAttachmentsTest-795961039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.127s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-59a21313-f61f-4ac0-9f31-dbb4ca4230b0 req-f58a9f7a-2f0f-413a-a1a2-86afcdab1a70 tempest-TaggedAttachmentsTest-795961039 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-36069d63-7254-4307-bba6-fa9195e7c70f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8aa2e5b8-1401-44eb-9b89-ed8729aee0d8', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:37:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-59a21313-f61f-4ac0-9f31-dbb4ca4230b0 req-f58a9f7a-2f0f-413a-a1a2-86afcdab1a70 tempest-TaggedAttachmentsTest-795961039 None] attachment_update completed successfully. Jul 05 02:37:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-1fd45548-46f9-4cf5-b2ef-c6e9b998ccb6 req-0b440848-5536-4d6d-aa70-d13132658145 tempest-TaggedAttachmentsTest-795961039 None] Terminate volume connection completed successfully. Jul 05 02:37:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-1fd45548-46f9-4cf5-b2ef-c6e9b998ccb6 req-0b440848-5536-4d6d-aa70-d13132658145 tempest-TaggedAttachmentsTest-795961039 None] Deleting attachment 8aa2e5b8-1401-44eb-9b89-ed8729aee0d8. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Flow 'volume_create_manager' (8f926f42-b132-490f-ab31-6ac58eb02a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7648ce67-9ebf-444f-9696-7ff7cda840e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7648ce67-9ebf-444f-9696-7ff7cda840e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1794875191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d784f221-6278-49c3-b63e-29d217644b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daaa9d21c2c14a88abc7e1d53835ddbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:37:28Z,use_quota=True,user_id='582bbcce83814667aa4d2b09f99fc159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc3aec0-8364-4cd4-8ce4-7c677cc38424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc3aec0-8364-4cd4-8ce4-7c677cc38424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48747145-05f3-4223-bebd-de02c1934a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48747145-05f3-4223-bebd-de02c1934a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd784f221-6278-49c3-b63e-29d217644b17', 'volume_name': 'volume-d784f221-6278-49c3-b63e-29d217644b17', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d9e578-b51c-4da5-8152-ea5488152ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d9e578-b51c-4da5-8152-ea5488152ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3441f68a-ca33-4d43-b8dc-55bd796166ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:28 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Volume d784f221-6278-49c3-b63e-29d217644b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d784f221-6278-49c3-b63e-29d217644b17', 'volume_size': 1} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1794875191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d784f221-6278-49c3-b63e-29d217644b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daaa9d21c2c14a88abc7e1d53835ddbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:37:28Z,use_quota=True,user_id='582bbcce83814667aa4d2b09f99fc159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Creating volume d784f221-6278-49c3-b63e-29d217644b17 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:37:28 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:37:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:28 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17 1073741824 Jul 05 02:37:28 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:29 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17 1073741824" returned: 0 in 1.248s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:29 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17 Jul 05 02:37:29 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17" returned: 0 in 1.079s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:37:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.402s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:30 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3441f68a-ca33-4d43-b8dc-55bd796166ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d784f221-6278-49c3-b63e-29d217644b17', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:30 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d924481c-571f-4c1d-868e-39c566d25403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:31 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Volume volume-d784f221-6278-49c3-b63e-29d217644b17 (d784f221-6278-49c3-b63e-29d217644b17): created successfully Jul 05 02:37:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d924481c-571f-4c1d-868e-39c566d25403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Flow 'volume_create_manager' (8f926f42-b132-490f-ab31-6ac58eb02a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:37:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-beda3a6a-450c-428f-a906-9c51aa67416a tempest-AttachVolumeShelveTestJSON-1202731763 None] Created volume successfully. Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Flow 'volume_create_manager' (673540b0-993b-41af-81b1-ca1bf155325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058463b0-c4be-4911-860b-7c5ee34c647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058463b0-c4be-4911-860b-7c5ee34c647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-726354045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0cfe31-e968-4083-b8af-05df82e01742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5300f5d2f6d452fb6f953e6e12c9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:37:35Z,use_quota=True,user_id='f71789f031484506837156e0232573a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cbb0f4-bc64-458d-87cc-fd0592f04a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cbb0f4-bc64-458d-87cc-fd0592f04a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83299db-b4f9-4822-bc2f-fdb879af67dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83299db-b4f9-4822-bc2f-fdb879af67dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0cfe31-e968-4083-b8af-05df82e01742', 'volume_name': 'volume-1b0cfe31-e968-4083-b8af-05df82e01742', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bda490-9007-43d0-9c0c-8ee4bda9a788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bda490-9007-43d0-9c0c-8ee4bda9a788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4b69d2-f13b-4c8e-80f5-adeecb8aef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:35 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Volume 1b0cfe31-e968-4083-b8af-05df82e01742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0cfe31-e968-4083-b8af-05df82e01742', 'volume_size': 1} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-726354045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0cfe31-e968-4083-b8af-05df82e01742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5300f5d2f6d452fb6f953e6e12c9f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:37:35Z,use_quota=True,user_id='f71789f031484506837156e0232573a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Creating volume 1b0cfe31-e968-4083-b8af-05df82e01742 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:37:35 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:37:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:35 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 1073741824 Jul 05 02:37:35 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:36 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 1073741824" returned: 0 in 1.435s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:37 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 Jul 05 02:37:37 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:38 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742" returned: 0 in 1.132s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] <== create_volume: return (2696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:37:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.699s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4b69d2-f13b-4c8e-80f5-adeecb8aef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0cfe31-e968-4083-b8af-05df82e01742', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244bd837-d941-4f7b-917d-f50d6d4896b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:37:38 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Volume volume-1b0cfe31-e968-4083-b8af-05df82e01742 (1b0cfe31-e968-4083-b8af-05df82e01742): created successfully Jul 05 02:37:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (244bd837-d941-4f7b-917d-f50d6d4896b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:37:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Flow 'volume_create_manager' (673540b0-993b-41af-81b1-ca1bf155325f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:37:38 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-7e5467e6-98f5-48fc-bd0b-c6e1846abea2 tempest-DeleteServersTestJSON-373508134 None] Created volume successfully. Jul 05 02:37:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-ad3f9da8-6179-4559-9219-d542ee4db971 req-9d9d3696-6623-41a9-94f8-cd736a43306f tempest-DeleteServersTestJSON-373508134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-ad3f9da8-6179-4559-9219-d542ee4db971 req-9d9d3696-6623-41a9-94f8-cd736a43306f tempest-DeleteServersTestJSON-373508134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:42 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d88bc3c-1162-4303-b5d6-d9cb4fe2c47b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:37:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-ad3f9da8-6179-4559-9219-d542ee4db971 req-9d9d3696-6623-41a9-94f8-cd736a43306f tempest-DeleteServersTestJSON-373508134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:42 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 Jul 05 02:37:42 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:43 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-ad3f9da8-6179-4559-9219-d542ee4db971 req-9d9d3696-6623-41a9-94f8-cd736a43306f tempest-DeleteServersTestJSON-373508134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742" returned: 0 in 0.772s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-ad3f9da8-6179-4559-9219-d542ee4db971 req-9d9d3696-6623-41a9-94f8-cd736a43306f tempest-DeleteServersTestJSON-373508134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.791s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-ad3f9da8-6179-4559-9219-d542ee4db971 req-9d9d3696-6623-41a9-94f8-cd736a43306f tempest-DeleteServersTestJSON-373508134 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-1b0cfe31-e968-4083-b8af-05df82e01742', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '008ca10f-9585-4317-acab-e77eff356b03', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:37:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-ad3f9da8-6179-4559-9219-d542ee4db971 req-9d9d3696-6623-41a9-94f8-cd736a43306f tempest-DeleteServersTestJSON-373508134 None] attachment_update completed successfully. Jul 05 02:37:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-5bfb9510-8030-4822-8cbf-8d05865dfbaa req-ca8ad457-4488-491a-973f-4620688aa08b tempest-ServerActionsTestOtherA-1706528703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-5bfb9510-8030-4822-8cbf-8d05865dfbaa req-ca8ad457-4488-491a-973f-4620688aa08b tempest-ServerActionsTestOtherA-1706528703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:44 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[300c6e38-afa7-45cb-8d71-18b62658ad17]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:37:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-5bfb9510-8030-4822-8cbf-8d05865dfbaa req-ca8ad457-4488-491a-973f-4620688aa08b tempest-ServerActionsTestOtherA-1706528703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:44 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 Jul 05 02:37:44 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:45 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-5bfb9510-8030-4822-8cbf-8d05865dfbaa req-ca8ad457-4488-491a-973f-4620688aa08b tempest-ServerActionsTestOtherA-1706528703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90" returned: 0 in 1.113s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-5bfb9510-8030-4822-8cbf-8d05865dfbaa req-ca8ad457-4488-491a-973f-4620688aa08b tempest-ServerActionsTestOtherA-1706528703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.139s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-5bfb9510-8030-4822-8cbf-8d05865dfbaa req-ca8ad457-4488-491a-973f-4620688aa08b tempest-ServerActionsTestOtherA-1706528703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-d1be7f49-083f-49bf-a36d-e1905c51cb90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '162880d6-46db-4f9e-a13a-85f653a4aaf4', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:37:46 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-5bfb9510-8030-4822-8cbf-8d05865dfbaa req-ca8ad457-4488-491a-973f-4620688aa08b tempest-ServerActionsTestOtherA-1706528703 None] attachment_update completed successfully. Jul 05 02:37:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Acquiring lock "cinder-36069d63-7254-4307-bba6-fa9195e7c70f-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:37:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Lock "cinder-36069d63-7254-4307-bba6-fa9195e7c70f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:37:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Acquiring lock "cinder-quobyte-36069d63-7254-4307-bba6-fa9195e7c70f" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:37:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Lock "cinder-quobyte-36069d63-7254-4307-bba6-fa9195e7c70f" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:37:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fac0ea-ad55-4feb-a11a-0b1ce137b228]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:37:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:46 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f Jul 05 02:37:46 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:47 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f" returned: 0 in 0.935s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:47 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f Jul 05 02:37:47 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:48 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-36069d63-7254-4307-bba6-fa9195e7c70f" returned: 0 in 0.750s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:48 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Lock "cinder-quobyte-36069d63-7254-4307-bba6-fa9195e7c70f" released by "delete_volume" :: held 1.728s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:37:48 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Created reservations ['a87e257e-b4cd-48ff-9ad6-2c66df146e11', '11428519-f2af-4b49-9575-0b210da101d3', '87657138-a7b9-4910-be29-0d02e591802e', '965286f7-9d20-455f-a123-0bdd44139b9e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:37:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:37:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:37:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:48 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:37:48 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:49 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.694s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:49 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:37:49 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Deleted volume successfully. Jul 05 02:37:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df78ce6e-10c2-4995-9ba8-d1a7ac1a3751 tempest-TaggedAttachmentsTest-795961039 None] Lock "cinder-36069d63-7254-4307-bba6-fa9195e7c70f-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:37:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-672d9561-5291-495c-8485-998869e6849c req-349750db-0992-42de-846d-1a60c62bc99a tempest-AttachVolumeShelveTestJSON-1202731763 None] No connector for attachment 9065fdd2-2fcc-4fa1-92ea-ad95e1910fb2; skipping storage backend terminate_connection call. {{(pid=86671) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5012}} Jul 05 02:37:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-672d9561-5291-495c-8485-998869e6849c req-349750db-0992-42de-846d-1a60c62bc99a tempest-AttachVolumeShelveTestJSON-1202731763 None] Deleting attachment 9065fdd2-2fcc-4fa1-92ea-ad95e1910fb2. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:37:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-eb27ae51-b80c-43a8-88a4-851eaf7d6e6e req-fa65aed1-aa31-41e5-a906-87e7c3d38a47 tempest-DeleteServersTestJSON-373508134 None] Terminate volume connection completed successfully. Jul 05 02:37:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-eb27ae51-b80c-43a8-88a4-851eaf7d6e6e req-fa65aed1-aa31-41e5-a906-87e7c3d38a47 tempest-DeleteServersTestJSON-373508134 None] Deleting attachment 008ca10f-9585-4317-acab-e77eff356b03. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:37:53 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-151fbeef-85b8-4d7e-ad1e-fc45bb1a2313 req-e98c0d19-820b-42d6-9e8d-d6726cd9787f tempest-ServerActionsTestOtherA-1706528703 None] Terminate volume connection completed successfully. Jul 05 02:37:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-151fbeef-85b8-4d7e-ad1e-fc45bb1a2313 req-e98c0d19-820b-42d6-9e8d-d6726cd9787f tempest-ServerActionsTestOtherA-1706528703 None] Deleting attachment 162880d6-46db-4f9e-a13a-85f653a4aaf4. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:37:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-151fbeef-85b8-4d7e-ad1e-fc45bb1a2313 req-5513bc03-0ead-4e3c-8f63-760b5659aa4b tempest-ServerActionsTestOtherA-1706528703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-151fbeef-85b8-4d7e-ad1e-fc45bb1a2313 req-5513bc03-0ead-4e3c-8f63-760b5659aa4b tempest-ServerActionsTestOtherA-1706528703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:56 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb0a10a-4681-4c4a-8519-6408e697e280]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:37:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-151fbeef-85b8-4d7e-ad1e-fc45bb1a2313 req-5513bc03-0ead-4e3c-8f63-760b5659aa4b tempest-ServerActionsTestOtherA-1706528703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:56 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 Jul 05 02:37:56 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Acquiring lock "cinder-1b0cfe31-e968-4083-b8af-05df82e01742-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:37:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Lock "cinder-1b0cfe31-e968-4083-b8af-05df82e01742-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:37:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Acquiring lock "cinder-quobyte-1b0cfe31-e968-4083-b8af-05df82e01742" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:37:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Lock "cinder-quobyte-1b0cfe31-e968-4083-b8af-05df82e01742" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:37:56 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[99739594-298f-4362-be5f-5cb40c795c80]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:37:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:56 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 Jul 05 02:37:56 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:57 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-151fbeef-85b8-4d7e-ad1e-fc45bb1a2313 req-5513bc03-0ead-4e3c-8f63-760b5659aa4b tempest-ServerActionsTestOtherA-1706528703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90" returned: 0 in 1.006s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-151fbeef-85b8-4d7e-ad1e-fc45bb1a2313 req-5513bc03-0ead-4e3c-8f63-760b5659aa4b tempest-ServerActionsTestOtherA-1706528703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.024s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-151fbeef-85b8-4d7e-ad1e-fc45bb1a2313 req-5513bc03-0ead-4e3c-8f63-760b5659aa4b tempest-ServerActionsTestOtherA-1706528703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-d1be7f49-083f-49bf-a36d-e1905c51cb90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3fda009f-b196-4abe-9c72-da9e78a435f6', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:37:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-151fbeef-85b8-4d7e-ad1e-fc45bb1a2313 req-5513bc03-0ead-4e3c-8f63-760b5659aa4b tempest-ServerActionsTestOtherA-1706528703 None] attachment_update completed successfully. Jul 05 02:37:57 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742" returned: 0 in 1.124s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:57 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742 Jul 05 02:37:57 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:58 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b0cfe31-e968-4083-b8af-05df82e01742" returned: 0 in 0.701s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Lock "cinder-quobyte-1b0cfe31-e968-4083-b8af-05df82e01742" released by "delete_volume" :: held 1.877s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:37:58 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Created reservations ['f3ca4637-8590-4069-b624-9b9c6decbb43', 'fa3bfbae-1c94-447e-9844-bc126c108fe7', 'c2d14e98-b209-412a-a0cb-a053869b2ee0', '14ca3c78-0d79-4db8-bb79-d275317dd498'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:37:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:37:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:37:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:37:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:37:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:37:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:37:58 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:37:58 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:37:59 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Jul 05 02:37:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.814s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:37:59 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:37:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Deleted volume successfully. Jul 05 02:37:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-db6d89c6-029c-45ba-9cdf-96819deffd2a tempest-DeleteServersTestJSON-373508134 None] Lock "cinder-1b0cfe31-e968-4083-b8af-05df82e01742-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:38:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:38:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:38:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:38:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:38:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:38:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:38:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:05 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:38:05 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.397s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:38:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:38:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 8 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:38:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:38:06 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:08 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=42,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=5 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:38:09 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=38,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Flow 'volume_create_manager' (cd66532d-123a-4477-afe4-d0f79225f938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67da5e19-40b9-4f34-b53c-4f5f652e73f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67da5e19-40b9-4f34-b53c-4f5f652e73f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1345313650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eca679e-4eaa-466e-b37a-569467a9fae5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0dce12ddbd294164a389f6e8c3ae4da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:38:11Z,use_quota=True,user_id='116fa42dc86343dfa9a967321e42036a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4416d4-1706-4644-9cd3-14b7a85132cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4416d4-1706-4644-9cd3-14b7a85132cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9aaf107-3ae7-4f11-838b-d6bb2029f66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9aaf107-3ae7-4f11-838b-d6bb2029f66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eca679e-4eaa-466e-b37a-569467a9fae5', 'volume_name': 'volume-8eca679e-4eaa-466e-b37a-569467a9fae5', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accb8110-12ab-4db1-a434-d84ee510fa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accb8110-12ab-4db1-a434-d84ee510fa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010f36ff-f0d2-4dc5-a4ee-cc5646453728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Volume 8eca679e-4eaa-466e-b37a-569467a9fae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eca679e-4eaa-466e-b37a-569467a9fae5', 'volume_size': 1} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1345313650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eca679e-4eaa-466e-b37a-569467a9fae5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0dce12ddbd294164a389f6e8c3ae4da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:38:11Z,use_quota=True,user_id='116fa42dc86343dfa9a967321e42036a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Creating volume 8eca679e-4eaa-466e-b37a-569467a9fae5 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:38:11 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:38:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:11 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5 1073741824 Jul 05 02:38:11 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:13 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5 1073741824" returned: 0 in 1.737s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:13 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5 Jul 05 02:38:13 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:14 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5" returned: 0 in 1.329s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] <== create_volume: return (3137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:38:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.142s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:38:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010f36ff-f0d2-4dc5-a4ee-cc5646453728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eca679e-4eaa-466e-b37a-569467a9fae5', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14f5809-bed2-4db1-81b2-c390cf89de80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:14 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Volume volume-8eca679e-4eaa-466e-b37a-569467a9fae5 (8eca679e-4eaa-466e-b37a-569467a9fae5): created successfully Jul 05 02:38:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14f5809-bed2-4db1-81b2-c390cf89de80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Flow 'volume_create_manager' (cd66532d-123a-4477-afe4-d0f79225f938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:38:14 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-9e4d3393-ec09-4d5e-8e32-213c891570ce req-2719e2b7-c241-43d1-ac52-34f34e8ae868 tempest-VolumesGetTestJSON-1936721724 None] Created volume successfully. Jul 05 02:38:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Acquiring lock "cinder-8eca679e-4eaa-466e-b37a-569467a9fae5-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:38:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Lock "cinder-8eca679e-4eaa-466e-b37a-569467a9fae5-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:38:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Acquiring lock "cinder-quobyte-8eca679e-4eaa-466e-b37a-569467a9fae5" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:38:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Lock "cinder-quobyte-8eca679e-4eaa-466e-b37a-569467a9fae5" acquired by "delete_volume" :: waited 0.038s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:38:16 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f2fd97-239f-45c9-8226-d1f6766bc029]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:38:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:16 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5 Jul 05 02:38:16 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:17 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5" returned: 0 in 1.720s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:17 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5 Jul 05 02:38:17 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:18 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8eca679e-4eaa-466e-b37a-569467a9fae5" returned: 0 in 1.053s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Lock "cinder-quobyte-8eca679e-4eaa-466e-b37a-569467a9fae5" released by "delete_volume" :: held 2.862s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:38:19 devstack cinder-volume[86671]: DEBUG cinder.quota [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Created reservations ['65f06d72-a5b7-4eb0-ac3a-875aeb67607c', '772f1efd-91a6-41d1-b341-67ce3a4de852', '3a3416e8-b6c8-4ee2-9065-7edebe908ab1', 'ae007f90-4134-4ed9-81b4-b33c126717f8'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:38:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:38:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:38:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:38:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:38:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:38:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:19 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:38:19 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:20 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.191s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:20 devstack cinder-volume[86671]: DEBUG cinder.manager [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:38:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Deleted volume successfully. Jul 05 02:38:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-927daab2-4fd7-4f81-af7a-576a45558f82 req-7f3fb40b-3ebb-4d5a-aa27-45dbdf7dff3d tempest-VolumesGetTestJSON-1936721724 None] Lock "cinder-8eca679e-4eaa-466e-b37a-569467a9fae5-delete_volume" released by "delete_volume" :: held 4.478s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:38:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-253db330-9d0e-41e8-80b6-1f465655a1a3 tempest-BackendsCapabilitiesAdminTestsJSON-827136016 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86671) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4832}} Jul 05 02:38:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4a47322b-e510-4995-8027-eb77289928ff tempest-BackendsCapabilitiesAdminTestsJSON-827136016 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86671) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4832}} Jul 05 02:38:29 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13,cinder:INSERT=4 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:38:30 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:38:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-86c3652c-d83b-4505-abd4-ff712a1874ed req-ba30e7d1-b69d-47e1-b622-0fd1e18c3129 tempest-ServerActionsTestOtherA-1706528703 None] Terminate volume connection completed successfully. Jul 05 02:38:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-86c3652c-d83b-4505-abd4-ff712a1874ed req-ba30e7d1-b69d-47e1-b622-0fd1e18c3129 tempest-ServerActionsTestOtherA-1706528703 None] Deleting attachment 3fda009f-b196-4abe-9c72-da9e78a435f6. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:38:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-818314e0-ccac-4405-90a5-cf5024aee2cf tempest-GroupsV314Test-187059597 None] Group tempest-GroupsV314Test-Group-1509732512: creating Jul 05 02:38:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-818314e0-ccac-4405-90a5-cf5024aee2cf tempest-GroupsV314Test-187059597 None] Group tempest-GroupsV314Test-Group-1509732512: created successfully Jul 05 02:38:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-818314e0-ccac-4405-90a5-cf5024aee2cf tempest-GroupsV314Test-187059597 None] Create group completed successfully. Jul 05 02:38:34 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:38:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Flow 'volume_create_manager' (2503f6b7-7a85-4f15-b675-1c5d0c96ee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:38:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7a255f-475e-434d-b745-4b2281237f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7a255f-475e-434d-b745-4b2281237f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338790782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3212d1b0-4672-47af-8c24-f0ba54307118,host='devstack@QuobyteHD#QuobyteHD',id=1f9e960f-3eff-440d-a981-1a18b591b1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6032a4e01d8340ca983fe949cb625379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:38:35Z,use_quota=True,user_id='2187cf16829046d1a51b77fba3fb24c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78517870-7025-43a6-bb5b-a283e8efa00c),volume_type_id=78517870-7025-43a6-bb5b-a283e8efa00c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a19bca-43d7-43c9-b2da-934992970c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a19bca-43d7-43c9-b2da-934992970c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8f12c0-c9b1-4325-95ae-e94cb0ad5fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8f12c0-c9b1-4325-95ae-e94cb0ad5fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f9e960f-3eff-440d-a981-1a18b591b1a6', 'volume_name': 'volume-1f9e960f-3eff-440d-a981-1a18b591b1a6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2f5baa-36f8-48a1-9369-e13ed8ccbfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2f5baa-36f8-48a1-9369-e13ed8ccbfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cf4031-0c11-485c-b183-c5453ed31653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:35 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Volume 1f9e960f-3eff-440d-a981-1a18b591b1a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f9e960f-3eff-440d-a981-1a18b591b1a6', 'volume_size': 1} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3212d1b0-4672-47af-8c24-f0ba54307118,created_at=2026-07-05T00:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338790782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3212d1b0-4672-47af-8c24-f0ba54307118,host='devstack@QuobyteHD#QuobyteHD',id=1f9e960f-3eff-440d-a981-1a18b591b1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6032a4e01d8340ca983fe949cb625379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:38:35Z,use_quota=True,user_id='2187cf16829046d1a51b77fba3fb24c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78517870-7025-43a6-bb5b-a283e8efa00c),volume_type_id=78517870-7025-43a6-bb5b-a283e8efa00c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Creating volume 1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:38:35 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:38:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:35 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 1073741824 Jul 05 02:38:35 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:36 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 1073741824" returned: 0 in 1.378s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:36 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 Jul 05 02:38:36 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:38 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6" returned: 0 in 1.526s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] <== create_volume: return (3047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:38:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.050s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:38:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cf4031-0c11-485c-b183-c5453ed31653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9e960f-3eff-440d-a981-1a18b591b1a6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3e17c0-6abe-4d36-935c-bfc21c2a0874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:38:38 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Volume volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 (1f9e960f-3eff-440d-a981-1a18b591b1a6): created successfully Jul 05 02:38:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3e17c0-6abe-4d36-935c-bfc21c2a0874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:38:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Flow 'volume_create_manager' (2503f6b7-7a85-4f15-b675-1c5d0c96ee25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:38:38 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-371ec83b-5a08-4583-bde2-86be72d007f3 tempest-GroupsV314Test-187059597 None] Created volume successfully. Jul 05 02:38:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:38:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:38:40 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Cloning volume 1f9e960f-3eff-440d-a981-1a18b591b1a6 to volume fbeb95d7-35c0-4f25-9ff6-650bffaa7402 Jul 05 02:38:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Creating offline snapshot f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 of volume 1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:38:40 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2cf07e-feb1-4743-87e4-47d09d492491]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:38:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:40 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 Jul 05 02:38:40 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:42 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6" returned: 0 in 1.608s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:42 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 1G Jul 05 02:38:42 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:43 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 1G" returned: 0 in 1.929s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:44 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 Jul 05 02:38:44 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:45 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16" returned: 0 in 1.825s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:45 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:38:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:45 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 Jul 05 02:38:45 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Acquiring lock "cinder-d1be7f49-083f-49bf-a36d-e1905c51cb90-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:38:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Lock "cinder-d1be7f49-083f-49bf-a36d-e1905c51cb90-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:38:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Acquiring lock "cinder-quobyte-d1be7f49-083f-49bf-a36d-e1905c51cb90" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:38:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Lock "cinder-quobyte-d1be7f49-083f-49bf-a36d-e1905c51cb90" acquired by "delete_volume" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:38:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cda9cf5-5eb0-44c5-bc70-f1fb8cfafd00]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:38:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:47 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 Jul 05 02:38:47 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:47 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16" returned: 0 in 1.554s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:47 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.info Jul 05 02:38:47 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:48 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90" returned: 0 in 1.172s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:48 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90 Jul 05 02:38:48 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:48 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.info" returned: 0 in 1.232s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:48 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:38:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:48 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.info Jul 05 02:38:48 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:49 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d1be7f49-083f-49bf-a36d-e1905c51cb90" returned: 0 in 0.798s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Lock "cinder-quobyte-d1be7f49-083f-49bf-a36d-e1905c51cb90" released by "delete_volume" :: held 2.063s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Created reservations ['ff6abf5f-e238-4a83-9c9f-61c4256080fb', '99fc9aea-3915-4297-aa64-fe7e7231e706', 'e16559c4-c383-4762-8ce7-0cc8a7d2e82b', '81e3cd37-f505-474e-849f-62994e1ef0e3'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:49 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:38:49 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:49 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.info" returned: 0 in 0.735s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Acquiring lock "cinder-quobyte-fbeb95d7-35c0-4f25-9ff6-650bffaa7402" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Lock "cinder-quobyte-fbeb95d7-35c0-4f25-9ff6-650bffaa7402" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] snapshot: f7e661fd-a4e2-4779-a3e9-1345b3ef8d16, volume: fbeb95d7-35c0-4f25-9ff6-650bffaa7402, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf875c-4d5b-478b-bbfa-4ef53e458b31]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:38:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:49 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 Jul 05 02:38:49 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:50 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.249s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:50 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:38:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Deleted volume successfully. Jul 05 02:38:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d19e271a-bc96-498c-b3f5-1f88a69d5493 tempest-ServerActionsTestOtherA-1706528703 None] Lock "cinder-d1be7f49-083f-49bf-a36d-e1905c51cb90-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:38:51 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16" returned: 0 in 1.506s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f9e960f-3eff-440d-a981-1a18b591b1a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1305bd62-7905-415e-a60d-70deee41bccd]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Acquiring lock "cinder-d784f221-6278-49c3-b63e-29d217644b17-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:38:51 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 Jul 05 02:38:51 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Lock "cinder-d784f221-6278-49c3-b63e-29d217644b17-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Acquiring lock "cinder-quobyte-d784f221-6278-49c3-b63e-29d217644b17" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Lock "cinder-quobyte-d784f221-6278-49c3-b63e-29d217644b17" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[801321dc-56c9-4b2d-84e6-19ae449564d7]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:38:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:51 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17 Jul 05 02:38:51 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:52 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6" returned: 0 in 1.250s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:52 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:38:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:52 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 Jul 05 02:38:52 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:52 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17" returned: 0 in 1.144s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:52 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17 Jul 05 02:38:52 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:53 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d784f221-6278-49c3-b63e-29d217644b17" returned: 0 in 0.849s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:53 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Lock "cinder-quobyte-d784f221-6278-49c3-b63e-29d217644b17" released by "delete_volume" :: held 2.069s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:38:53 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Created reservations ['73f7ae32-a52f-4c7c-bb67-fac16678b294', 'ace7244e-40df-4ff1-8b50-4cad1c15f7a1', '372e4197-61f5-4017-a226-8638e717c2b6', '10d9cbff-bc37-43d0-a118-f4f34af43445'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:38:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:38:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:38:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:38:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:38:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:38:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:38:53 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:38:53 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:38:55 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Jul 05 02:38:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.455s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:38:55 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:38:55 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Deleted volume successfully. Jul 05 02:38:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6d130a4-2884-428e-a51b-abacb3a181bc tempest-AttachVolumeShelveTestJSON-1202731763 None] Lock "cinder-d784f221-6278-49c3-b63e-29d217644b17-delete_volume" released by "delete_volume" :: held 4.059s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:38:59 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Flow 'volume_create_manager' (d53fc1ab-a8ce-44ba-9f32-19098d77b351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3826b2-724b-4610-b5b5-50a26a645e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3826b2-724b-4610-b5b5-50a26a645e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1370495684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e89b18-77fb-4b83-89d7-42501ad1bf1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d7fdc4dce8447d894cfe0cd9bb2f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:00Z,use_quota=True,user_id='2ebf34b9fdae48e19999f27c24ba9456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bce1fdb-79c3-4364-a0b3-5fa5cf94819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bce1fdb-79c3-4364-a0b3-5fa5cf94819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe76264-f4d7-4d6d-b10b-50f819f4e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe76264-f4d7-4d6d-b10b-50f819f4e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e89b18-77fb-4b83-89d7-42501ad1bf1f', 'volume_name': 'volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128990fa-28c0-425c-b01c-aba487bbc93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128990fa-28c0-425c-b01c-aba487bbc93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3487fe-9816-4137-b3eb-237e2643cd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:00 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Volume 03e89b18-77fb-4b83-89d7-42501ad1bf1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f', 'volume_size': 1} Jul 05 02:39:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:01 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402" returned: 0 in 8.726s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:01 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b1e69b-bcea-4165-872c-f6103838b3a8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:01 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 Jul 05 02:39:01 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:03 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6" returned: 0 in 2.179s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:03 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:39:03 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Converted 1024.00 MB image at 117.32 MB/s Jul 05 02:39:03 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:39:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:03 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 Jul 05 02:39:03 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:04 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402" returned: 0 in 0.881s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Lock "cinder-quobyte-fbeb95d7-35c0-4f25-9ff6-650bffaa7402" released by "_copy_volume_from_snapshot" :: held 14.749s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Acquiring lock "cinder-quobyte-f7e661fd-a4e2-4779-a3e9-1345b3ef8d16" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:39:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Lock "cinder-quobyte-f7e661fd-a4e2-4779-a3e9-1345b3ef8d16" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:39:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Deleting offline snapshot f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 of volume 1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:39:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] snapshot_file for this snap is: volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:39:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4358e19a-9d6c-4c4f-a325-fb00d8ef1c87]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:04 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 Jul 05 02:39:04 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:39:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:05 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:39:05 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:05 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16" returned: 0 in 1.490s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f9e960f-3eff-440d-a981-1a18b591b1a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:39:06 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05e7f36-0efa-41ff-9a1e-4a9b5384e62b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:06 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 Jul 05 02:39:06 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:06 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.468s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:39:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:39:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 8 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:39:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:39:07 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6" returned: 0 in 1.109s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:07 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 Jul 05 02:39:07 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:08 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16" returned: 0 in 1.194s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:08 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16 Jul 05 02:39:08 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:09 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6.f7e661fd-a4e2-4779-a3e9-1345b3ef8d16" returned: 0 in 1.067s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Lock "cinder-quobyte-f7e661fd-a4e2-4779-a3e9-1345b3ef8d16" released by "_delete_snapshot" :: held 5.124s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 29.171s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.121s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1370495684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e89b18-77fb-4b83-89d7-42501ad1bf1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d7fdc4dce8447d894cfe0cd9bb2f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:00Z,use_quota=True,user_id='2ebf34b9fdae48e19999f27c24ba9456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Creating volume 03e89b18-77fb-4b83-89d7-42501ad1bf1f {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:39:09 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:39:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:09 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f 1073741824 Jul 05 02:39:09 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:09 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ee012ae4-c117-41a4-9371-5180c1e78f0d tempest-GroupsV314Test-187059597 None] Create group from source-group-3212d1b0-4672-47af-8c24-f0ba54307118 completed successfully. Jul 05 02:39:10 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f 1073741824" returned: 0 in 1.106s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:10 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f Jul 05 02:39:10 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:11 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f" returned: 0 in 0.771s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3487fe-9816-4137-b3eb-237e2643cd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6d3ebb-578f-44d6-a5e4-4f0925bcd52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Volume volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f (03e89b18-77fb-4b83-89d7-42501ad1bf1f): created successfully Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6d3ebb-578f-44d6-a5e4-4f0925bcd52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Flow 'volume_create_manager' (d53fc1ab-a8ce-44ba-9f32-19098d77b351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1992fcc1-eebc-4d46-9e00-75f7efaa893d tempest-ServerRescueNegativeTestJSON-353282873 None] Created volume successfully. Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Acquiring lock "cinder-quobyte-fbeb95d7-35c0-4f25-9ff6-650bffaa7402" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Lock "cinder-quobyte-fbeb95d7-35c0-4f25-9ff6-650bffaa7402" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ea3c89-fc9f-4cdc-a5a6-d8066f4393e6]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:11 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 Jul 05 02:39:11 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:12 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402" returned: 0 in 0.948s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:12 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402 Jul 05 02:39:12 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Flow 'volume_create_manager' (ffd18497-194e-4ca9-b722-cf7ebdf1e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33e55cf-38e7-4daf-bc63-dd58534b4506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33e55cf-38e7-4daf-bc63-dd58534b4506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-622989475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89a520c0fbe4a8c88f6ee29c85985b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:13Z,use_quota=True,user_id='cfb417963d284ccda485f91473dd1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50df69a2-64ea-487f-aa78-90dd46b96c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50df69a2-64ea-487f-aa78-90dd46b96c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:13 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f86efb1-9c99-4248-9675-97241d08a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f86efb1-9c99-4248-9675-97241d08a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87', 'volume_name': 'volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d1cf3b-70bf-4a8d-9903-f615b7c14fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d1cf3b-70bf-4a8d-9903-f615b7c14fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9d0c87-f60f-49e1-a2f3-a074077625b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:13 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Volume b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87', 'volume_size': 1} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-622989475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89a520c0fbe4a8c88f6ee29c85985b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:13Z,use_quota=True,user_id='cfb417963d284ccda485f91473dd1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Creating volume b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:39:13 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fbeb95d7-35c0-4f25-9ff6-650bffaa7402" returned: 0 in 0.867s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:13 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 1073741824 Jul 05 02:39:13 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Lock "cinder-quobyte-fbeb95d7-35c0-4f25-9ff6-650bffaa7402" released by "delete_volume" :: held 1.898s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Created reservations ['52e6e816-4fe7-442d-830f-603d9edb10d6'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:39:13 devstack cinder-volume[86671]: WARNING cinder.quota [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1025449755 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1025449755, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:39:13 devstack cinder-volume[86671]: WARNING cinder.quota [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1025449755 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1025449755, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Created reservations ['1e5b568b-4f4b-4317-8d27-4a001b909f05', 'd9a2a441-0255-4f81-96ec-53bd12895ce6', '1a1a0779-48cc-474a-8136-02ed1d0de293', '82523703-4f20-4e15-879b-8dbc945927bd'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:13 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:39:13 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Acquiring lock "cinder-quobyte-1f9e960f-3eff-440d-a981-1a18b591b1a6" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:39:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Lock "cinder-quobyte-1f9e960f-3eff-440d-a981-1a18b591b1a6" acquired by "delete_volume" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:39:14 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 1073741824" returned: 0 in 1.265s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:14 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[49877c63-1298-4f52-8b48-e7b21a869dfe]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:14 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 Jul 05 02:39:14 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:14 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 Jul 05 02:39:14 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:15 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.191s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:39:15 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ac7894ec-5514-46df-a26f-b3bb6592ee4b tempest-GroupsV314Test-187059597 None] Delete group completed successfully. Jul 05 02:39:15 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" returned: 0 in 0.798s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9d0c87-f60f-49e1-a2f3-a074077625b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9aea930-bff7-4259-992c-7e2815e6fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:15 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Volume volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 (b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87): created successfully Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9aea930-bff7-4259-992c-7e2815e6fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Flow 'volume_create_manager' (ffd18497-194e-4ca9-b722-cf7ebdf1e26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:15 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:15 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-cf8638b6-eb07-4bdc-bfbf-b4da702ded89 req-2240c432-b3bf-4db5-a53a-b39e48e7d84d tempest-VolumesSnapshotsTestJSON-1137350832 None] Created volume successfully. Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6" returned: 0 in 0.905s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:15 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6 Jul 05 02:39:15 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:16 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1f9e960f-3eff-440d-a981-1a18b591b1a6" returned: 0 in 0.693s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Lock "cinder-quobyte-1f9e960f-3eff-440d-a981-1a18b591b1a6" released by "delete_volume" :: held 1.706s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:16 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Created reservations ['a0ad3bb8-f3bc-4596-ba6b-a9459ec346b4'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:39:16 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Created reservations ['1c5d7bd4-fa24-4578-8589-b8d9eb2a2f84', 'cdbf0298-392b-49e7-95b9-ae7e6ccd15d2', '22c10f68-1e88-44ed-a3e5-47b6819213e3', 'bcd28c68-2fc5-4f63-964d-9d1e426c7dfd'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:39:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:16 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:39:16 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Creating offline snapshot 1bd18ec2-a067-46e9-a0ea-994a08076262 of volume b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:39:17 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2374b3-43fb-423c-9035-010976986dc9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:17 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 Jul 05 02:39:17 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:17 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.339s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:17 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:39:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e056e6ea-3263-4ca1-9948-6fc947c2c266 tempest-GroupsV314Test-187059597 None] Delete group completed successfully. Jul 05 02:39:18 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" returned: 0 in 1.178s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:18 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 1G Jul 05 02:39:18 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:19 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 1G" returned: 0 in 1.186s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:19 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 Jul 05 02:39:19 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:20 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262" returned: 0 in 0.944s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:20 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 is being set with open permissions: ugo+rw Jul 05 02:39:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:20 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 Jul 05 02:39:20 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:21 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262" returned: 0 in 0.780s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:21 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.info Jul 05 02:39:21 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:22 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.info" returned: 0 in 1.000s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:22 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.info is being set with open permissions: ugo+rw Jul 05 02:39:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:22 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.info Jul 05 02:39:22 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:23 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.info" returned: 0 in 1.075s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.331s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:23 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-56e0554b-ede6-4a0f-a2b1-aa1b6f1251bc req-156e0ef7-7232-4bc1-ab97-eb5706ae260d tempest-VolumesSnapshotsTestJSON-1137350832 None] Create snapshot completed successfully Jul 05 02:39:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Acquiring lock "cinder-1bd18ec2-a067-46e9-a0ea-994a08076262-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:39:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "cinder-1bd18ec2-a067-46e9-a0ea-994a08076262-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:39:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Acquiring lock "cinder-quobyte-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:39:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "cinder-quobyte-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:39:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Acquiring lock "cinder-quobyte-1bd18ec2-a067-46e9-a0ea-994a08076262" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:39:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "cinder-quobyte-1bd18ec2-a067-46e9-a0ea-994a08076262" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:39:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Deleting offline snapshot 1bd18ec2-a067-46e9-a0ea-994a08076262 of volume b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:39:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] snapshot_file for this snap is: volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:39:24 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[04873e4d-0f61-4444-b83f-8a669a6a254e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:24 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 Jul 05 02:39:24 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:25 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262" returned: 0 in 1.029s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:39:25 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[436d2a5e-4225-4c74-bdf4-849b32582f2d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:26 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 Jul 05 02:39:26 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:27 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" returned: 0 in 1.151s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:27 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 Jul 05 02:39:27 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:28 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262" returned: 0 in 1.351s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:28 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262 Jul 05 02:39:28 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:29 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87.1bd18ec2-a067-46e9-a0ea-994a08076262" returned: 0 in 0.722s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "cinder-quobyte-1bd18ec2-a067-46e9-a0ea-994a08076262" released by "_delete_snapshot" :: held 4.522s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "cinder-quobyte-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" released by "delete_snapshot" :: held 4.570s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:29 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=51,cinder:INSERT=12,cinder:UPDATE=51,cinder:DELETE=4 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:39:29 devstack cinder-volume[86671]: WARNING cinder.quota [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:39:29 devstack cinder-volume[86671]: DEBUG cinder.quota [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Created reservations ['adaeaec1-feaf-4400-b287-9968ac7a7ce7', '98dfafc3-e3a5-48a9-a3fe-7e5b5790987d', 'd8923d33-a1a4-47d4-879e-4eb0c89bb7fb', 'd4f7eba4-254e-4f72-9aba-92f62e9b2929'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:39:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Delete snapshot completed successfully. Jul 05 02:39:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-1e140edf-4d45-4b92-9605-0b474b67b09d req-03453f80-5046-45e9-aaca-7757817baf52 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "cinder-1bd18ec2-a067-46e9-a0ea-994a08076262-delete_snapshot" released by "delete_snapshot" :: held 4.814s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Acquiring lock "cinder-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:39:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "cinder-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:39:30 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=56,cinder:UPDATE=59,cinder:INSERT=15,cinder:DELETE=2 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:39:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Acquiring lock "cinder-quobyte-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:39:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "cinder-quobyte-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" acquired by "delete_volume" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:39:30 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cee6d3-5b6e-4b20-ac5d-8f3139496a75]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:30 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 Jul 05 02:39:30 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Acquiring lock "cinder-03e89b18-77fb-4b83-89d7-42501ad1bf1f-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:39:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Lock "cinder-03e89b18-77fb-4b83-89d7-42501ad1bf1f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:39:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Acquiring lock "cinder-quobyte-03e89b18-77fb-4b83-89d7-42501ad1bf1f" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:39:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Lock "cinder-quobyte-03e89b18-77fb-4b83-89d7-42501ad1bf1f" acquired by "delete_volume" :: waited 0.034s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:39:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c215f4-1647-47d0-a112-51d06edb4614]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:31 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f Jul 05 02:39:31 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:31 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" returned: 0 in 1.136s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:31 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87 Jul 05 02:39:31 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:32 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" returned: 0 in 0.869s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "cinder-quobyte-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87" released by "delete_volume" :: held 2.081s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG cinder.quota [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Created reservations ['83905996-b473-4591-949c-ce429975247a', 'b2cac6bb-622f-4cfd-b8c9-29338a984536', 'a32d1a3d-1119-41e9-a7c7-828646aa3e59', '961e634a-103e-43e3-96c4-21ada2c59c02'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:39:32 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f" returned: 0 in 1.163s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:32 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f Jul 05 02:39:32 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:32 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:39:32 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:34 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.255s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG cinder.manager [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:39:34 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:34 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Deleted volume successfully. Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03e89b18-77fb-4b83-89d7-42501ad1bf1f" returned: 0 in 1.413s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Lock "cinder-quobyte-03e89b18-77fb-4b83-89d7-42501ad1bf1f" released by "delete_volume" :: held 2.661s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-67578c9f-300a-41b3-987f-5d5cbfdfe02d req-213180e7-d36e-460b-92c8-8afe47b6aa81 tempest-VolumesSnapshotsTestJSON-1137350832 None] Lock "cinder-b971bf22-5d4b-4ddc-aac9-ba0a9d8dba87-delete_volume" released by "delete_volume" :: held 3.761s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Created reservations ['aa54064e-baf7-47de-bb1a-c58741393d88', '9f9cfe72-6675-4415-9a24-95925dc12e3c', 'c5c08dd9-f248-4c8e-a923-8d1600a6c6f0', '8773b992-be7e-4b96-ac2f-beada37c893a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:34 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:39:34 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:35 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.932s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:35 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:39:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Deleted volume successfully. Jul 05 02:39:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bce6cf87-b5ed-4db9-a32d-340b16803504 tempest-ServerRescueNegativeTestJSON-353282873 None] Lock "cinder-03e89b18-77fb-4b83-89d7-42501ad1bf1f-delete_volume" released by "delete_volume" :: held 3.965s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Flow 'volume_create_manager' (2adbc8a3-2a11-47b2-b3ab-96ae19b7bd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cf8544-9cff-4241-b8ae-5cdaccfb08d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17cf8544-9cff-4241-b8ae-5cdaccfb08d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1473403100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99627a6e-ef25-4fbe-9ad9-6d6e3f4591da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426377d95b034600842b913b41a0f927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:43Z,use_quota=True,user_id='885203d67e344c4d95b79c21986fa0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e233509-0ec2-4b16-864e-67f0ab8a116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e233509-0ec2-4b16-864e-67f0ab8a116c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581f2651-7781-4b64-bf45-e267d20a42bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581f2651-7781-4b64-bf45-e267d20a42bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99627a6e-ef25-4fbe-9ad9-6d6e3f4591da', 'volume_name': 'volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5aa588-d5ab-4cb0-a8fc-abf8752dc8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5aa588-d5ab-4cb0-a8fc-abf8752dc8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca8b5e0-95fc-4137-8ad4-d8c71c10be78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:43 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Volume 99627a6e-ef25-4fbe-9ad9-6d6e3f4591da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da', 'volume_size': 1} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1473403100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99627a6e-ef25-4fbe-9ad9-6d6e3f4591da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426377d95b034600842b913b41a0f927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:43Z,use_quota=True,user_id='885203d67e344c4d95b79c21986fa0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Creating volume 99627a6e-ef25-4fbe-9ad9-6d6e3f4591da {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:39:43 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:39:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:43 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da 1073741824 Jul 05 02:39:43 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:44 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da 1073741824" returned: 0 in 1.178s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:44 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da Jul 05 02:39:44 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:45 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da" returned: 0 in 0.725s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:39:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca8b5e0-95fc-4137-8ad4-d8c71c10be78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ca8706-69e3-46d7-919e-8f6a0090f440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:45 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Volume volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da (99627a6e-ef25-4fbe-9ad9-6d6e3f4591da): created successfully Jul 05 02:39:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ca8706-69e3-46d7-919e-8f6a0090f440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Flow 'volume_create_manager' (2adbc8a3-2a11-47b2-b3ab-96ae19b7bd61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-571c1350-6e98-4442-8c4e-7e4593901d99 tempest-VolumesListAdminTestJSON-1353222677 None] Created volume successfully. Jul 05 02:39:47 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6af0e9e6-16ef-4482-83bd-ec16065c970f tempest-GroupSnapshotsTest-2146552497 None] Group tempest-GroupSnapshotsTest-Group-935965036: creating Jul 05 02:39:47 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6af0e9e6-16ef-4482-83bd-ec16065c970f tempest-GroupSnapshotsTest-2146552497 None] Group tempest-GroupSnapshotsTest-Group-935965036: created successfully Jul 05 02:39:47 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6af0e9e6-16ef-4482-83bd-ec16065c970f tempest-GroupSnapshotsTest-2146552497 None] Create group completed successfully. Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Flow 'volume_create_manager' (665a5c8f-a6e2-4dc8-b529-4d30b6d4720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcdde16-8a8a-4d12-a860-c3afb1fc2dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcdde16-8a8a-4d12-a860-c3afb1fc2dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1051005107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c6f3af-789b-4e81-bb52-e4291263d39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426377d95b034600842b913b41a0f927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:48Z,use_quota=True,user_id='885203d67e344c4d95b79c21986fa0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15310a1f-6df0-40f6-88df-ac7ed2b44912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15310a1f-6df0-40f6-88df-ac7ed2b44912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08af86e2-6bf5-4590-badc-cb9331ea68a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08af86e2-6bf5-4590-badc-cb9331ea68a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c6f3af-789b-4e81-bb52-e4291263d39a', 'volume_name': 'volume-a6c6f3af-789b-4e81-bb52-e4291263d39a', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12274cbf-a35d-4b48-b4d3-2f52fd0aef57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12274cbf-a35d-4b48-b4d3-2f52fd0aef57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c834121f-87a1-43cf-81f4-0eb56eb77dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:48 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Volume a6c6f3af-789b-4e81-bb52-e4291263d39a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c6f3af-789b-4e81-bb52-e4291263d39a', 'volume_size': 1} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1051005107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c6f3af-789b-4e81-bb52-e4291263d39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426377d95b034600842b913b41a0f927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:48Z,use_quota=True,user_id='885203d67e344c4d95b79c21986fa0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Creating volume a6c6f3af-789b-4e81-bb52-e4291263d39a {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:39:48 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:39:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:48 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a 1073741824 Jul 05 02:39:48 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Flow 'volume_create_manager' (673f50d8-a7ab-4d09-8983-76eb1a07c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5945de-e633-4d52-8755-30e83e93aeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5945de-e633-4d52-8755-30e83e93aeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1266722914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe00f2f2-5a07-467d-84c9-65b007b9cbc9,host='devstack@QuobyteHD#QuobyteHD',id=82982ce6-33fc-4b10-8e73-761ff4c3242f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62e0725244483e993e47d328143032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:49Z,use_quota=True,user_id='d4e3df42b954442087a85704741e5303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c3f9ad9-dbcd-4e31-bf15-0ceca7da82d5),volume_type_id=6c3f9ad9-dbcd-4e31-bf15-0ceca7da82d5)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a57de45-9bf6-4437-b625-eca3a9a76be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a57de45-9bf6-4437-b625-eca3a9a76be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50e96e4-6fae-481e-b84c-9fff045d8293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50e96e4-6fae-481e-b84c-9fff045d8293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82982ce6-33fc-4b10-8e73-761ff4c3242f', 'volume_name': 'volume-82982ce6-33fc-4b10-8e73-761ff4c3242f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2887fbda-2c1e-4add-9a96-1fd879c3cf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2887fbda-2c1e-4add-9a96-1fd879c3cf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6704bea0-3f34-488e-aa3a-6d5dd7f5d699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:49 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Volume 82982ce6-33fc-4b10-8e73-761ff4c3242f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82982ce6-33fc-4b10-8e73-761ff4c3242f', 'volume_size': 1} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:49 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a 1073741824" returned: 0 in 1.470s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:49 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a Jul 05 02:39:49 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:50 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a" returned: 0 in 0.716s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe00f2f2-5a07-467d-84c9-65b007b9cbc9,created_at=2026-07-05T00:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1266722914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe00f2f2-5a07-467d-84c9-65b007b9cbc9,host='devstack@QuobyteHD#QuobyteHD',id=82982ce6-33fc-4b10-8e73-761ff4c3242f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62e0725244483e993e47d328143032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:49Z,use_quota=True,user_id='d4e3df42b954442087a85704741e5303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c3f9ad9-dbcd-4e31-bf15-0ceca7da82d5),volume_type_id=6c3f9ad9-dbcd-4e31-bf15-0ceca7da82d5)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Creating volume 82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:39:50 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:50 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f 1073741824 Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c834121f-87a1-43cf-81f4-0eb56eb77dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c6f3af-789b-4e81-bb52-e4291263d39a', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:50 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8f6c85-df15-4292-9b10-aaade73150df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:50 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Volume volume-a6c6f3af-789b-4e81-bb52-e4291263d39a (a6c6f3af-789b-4e81-bb52-e4291263d39a): created successfully Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8f6c85-df15-4292-9b10-aaade73150df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Flow 'volume_create_manager' (665a5c8f-a6e2-4dc8-b529-4d30b6d4720b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-761634ea-bbe8-4e43-86fe-31a1452f1b83 tempest-VolumesListAdminTestJSON-1353222677 None] Created volume successfully. Jul 05 02:39:51 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f 1073741824" returned: 0 in 0.980s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:51 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f Jul 05 02:39:51 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:51 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:39:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Flow 'volume_create_manager' (88fbf950-661d-4a59-a421-08e2a1016fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5408116b-1616-41a1-819e-07242ff652e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5408116b-1616-41a1-819e-07242ff652e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1185168786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426377d95b034600842b913b41a0f927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:52Z,use_quota=True,user_id='885203d67e344c4d95b79c21986fa0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61ba380-b66c-4930-aec7-049b18cb665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61ba380-b66c-4930-aec7-049b18cb665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fd786c-2527-4902-99da-30c909c13020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fd786c-2527-4902-99da-30c909c13020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4', 'volume_name': 'volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451b60a3-9eb9-4464-941a-43c220b43c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451b60a3-9eb9-4464-941a-43c220b43c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fcedae-c606-4a1d-bfd5-78065f156285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:52 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Volume d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4', 'volume_size': 1} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:52 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f" returned: 0 in 0.878s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.355s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1185168786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426377d95b034600842b913b41a0f927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:52Z,use_quota=True,user_id='885203d67e344c4d95b79c21986fa0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Creating volume d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:39:52 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:52 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 1073741824 Jul 05 02:39:52 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6704bea0-3f34-488e-aa3a-6d5dd7f5d699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82982ce6-33fc-4b10-8e73-761ff4c3242f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c5fa01-3d0d-4647-bf08-993d8a9b1d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:52 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Volume volume-82982ce6-33fc-4b10-8e73-761ff4c3242f (82982ce6-33fc-4b10-8e73-761ff4c3242f): created successfully Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c5fa01-3d0d-4647-bf08-993d8a9b1d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Flow 'volume_create_manager' (673f50d8-a7ab-4d09-8983-76eb1a07c70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d8ab95c0-e093-4eba-8831-91eeb64b0f74 tempest-GroupSnapshotsTest-2146552497 None] Created volume successfully. Jul 05 02:39:53 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 1073741824" returned: 0 in 1.019s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:53 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] GroupSnapshot 435cb7ed-9748-414a-9a5b-d26a63df1698: creating. Jul 05 02:39:53 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 Jul 05 02:39:53 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Group snapshot 435cb7ed-9748-414a-9a5b-d26a63df1698: creating. {{(pid=86671) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4177}} Jul 05 02:39:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:54 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4" returned: 0 in 0.834s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.731s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Creating offline snapshot 141373c4-564a-442d-b533-587e66ccf171 of volume 82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fcedae-c606-4a1d-bfd5-78065f156285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e1e24d-c043-4604-bdb0-2b3997697572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6019834-da27-46b1-9d1c-2315728133d6]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:54 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Volume volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 (d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4): created successfully Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e1e24d-c043-4604-bdb0-2b3997697572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Flow 'volume_create_manager' (88fbf950-661d-4a59-a421-08e2a1016fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:54 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1c0fcc74-f24e-45cf-98e8-578d51b7878b tempest-VolumesListAdminTestJSON-1353222677 None] Created volume successfully. Jul 05 02:39:54 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f Jul 05 02:39:54 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:55 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f" returned: 0 in 0.988s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:55 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 1G Jul 05 02:39:55 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Flow 'volume_create_manager' (ded35884-22ee-4abb-941c-43957b5a3de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f94551e-a309-425a-a514-944aaa76c645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f94551e-a309-425a-a514-944aaa76c645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7a15a5-265d-424a-a1c2-fbbddd46f7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5f069a9f874fa286555d7950252f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:56Z,use_quota=True,user_id='72da4936056d419cbf01f318f8be7a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60b538c-742c-4d5d-a2d5-0597035299b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60b538c-742c-4d5d-a2d5-0597035299b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52260f6e-22bf-4033-91ec-b41b2e7f79e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52260f6e-22bf-4033-91ec-b41b2e7f79e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7a15a5-265d-424a-a1c2-fbbddd46f7a6', 'volume_name': 'volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77abbdd-4a83-4e2d-baed-582a7e8d1426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77abbdd-4a83-4e2d-baed-582a7e8d1426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fb30d8-be03-4c1f-aff0-71a85fa632ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:39:56 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Volume fb7a15a5-265d-424a-a1c2-fbbddd46f7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6', 'volume_size': 1} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:56 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 1G" returned: 0 in 1.242s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82982ce6-33fc-4b10-8e73-761ff4c3242f -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:56 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82982ce6-33fc-4b10-8e73-761ff4c3242f -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 Jul 05 02:39:56 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:57 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82982ce6-33fc-4b10-8e73-761ff4c3242f -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171" returned: 0 in 1.003s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:57 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:39:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:57 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 Jul 05 02:39:57 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:58 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171" returned: 0 in 0.773s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:58 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.info Jul 05 02:39:58 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:59 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.info" returned: 0 in 0.693s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:59 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:59 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.info Jul 05 02:39:59 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:59 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.info" returned: 0 in 0.648s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.460s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.413s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7a15a5-265d-424a-a1c2-fbbddd46f7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e5f069a9f874fa286555d7950252f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:39:56Z,use_quota=True,user_id='72da4936056d419cbf01f318f8be7a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Creating volume fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:39:59 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:39:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:39:59 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 1073741824 Jul 05 02:39:59 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:39:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2616d0ac-21a6-484c-a93a-b1407e7d73ed tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 435cb7ed-9748-414a-9a5b-d26a63df1698: created successfully Jul 05 02:40:00 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 1073741824" returned: 0 in 0.906s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:00 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 Jul 05 02:40:00 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:01 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6" returned: 0 in 0.699s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fb30d8-be03-4c1f-aff0-71a85fa632ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156eb1a6-20a4-4e19-9359-591b66cc466b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:01 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Volume volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 (fb7a15a5-265d-424a-a1c2-fbbddd46f7a6): created successfully Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156eb1a6-20a4-4e19-9359-591b66cc466b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Flow 'volume_create_manager' (ded35884-22ee-4abb-941c-43957b5a3de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:01 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-32a8aa07-e7ce-4265-97af-c46c117b33cb tempest-VolumesListAdminTestJSON-1910639366 None] Created volume successfully. Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Acquiring lock "cinder-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Lock "cinder-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Acquiring lock "cinder-quobyte-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Lock "cinder-quobyte-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e030b5-d0db-48f9-ad90-4f029efc1ebc]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "cinder-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:01 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 Jul 05 02:40:01 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "cinder-quobyte-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-quobyte-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[477204a6-0990-4683-938c-ab5a074e9a7a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:02 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 Jul 05 02:40:02 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-141373c4-564a-442d-b533-587e66ccf171-27784b8e-921f-491a-aa84-f2e428db8381" by "_create_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-141373c4-564a-442d-b533-587e66ccf171-27784b8e-921f-491a-aa84-f2e428db8381" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Creating volume 27784b8e-921f-491a-aa84-f2e428db8381 from snapshot 141373c4-564a-442d-b533-587e66ccf171 {{(pid=86671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-27784b8e-921f-491a-aa84-f2e428db8381" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-27784b8e-921f-491a-aa84-f2e428db8381" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] snapshot: 141373c4-564a-442d-b533-587e66ccf171, volume: 27784b8e-921f-491a-aa84-f2e428db8381, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2a0dd5-e98f-4889-a7fe-2c8bd40d1d35]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:02 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 Jul 05 02:40:02 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:02 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6" returned: 0 in 1.032s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:02 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6 Jul 05 02:40:02 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:03 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4" returned: 0 in 0.986s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:03 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4 Jul 05 02:40:03 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:03 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171" returned: 0 in 0.950s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82982ce6-33fc-4b10-8e73-761ff4c3242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ed2254-cae1-437c-99eb-cb924cee332b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:03 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f Jul 05 02:40:03 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:03 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6" returned: 0 in 0.904s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:03 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4" returned: 0 in 0.747s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Lock "cinder-quobyte-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6" released by "delete_volume" :: held 2.020s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-quobyte-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4" released by "delete_volume" :: held 1.816s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Created reservations ['fbb7e9a4-d912-402c-8d09-0433f8f40d4e', 'f9162898-71c2-4b21-b855-b73460646a78', '37840f95-84cf-48d0-9e3d-86810e4433ab', '7171c855-4c51-4bb6-913b-a6d7793e6c28'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:03 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Created reservations ['609de978-f275-4b3e-8d9b-cc48146b1d02', '9d2d7c2f-01fd-42d9-8379-043e1a90d78a', '04599cb0-8b20-46dd-9e0d-f077ed166b46', 'ec7a750e-7761-47af-8791-5c5440b60845'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:04 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:40:04 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:04 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:40:04 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "cinder-a6c6f3af-789b-4e81-bb52-e4291263d39a-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-a6c6f3af-789b-4e81-bb52-e4291263d39a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "cinder-quobyte-a6c6f3af-789b-4e81-bb52-e4291263d39a" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-quobyte-a6c6f3af-789b-4e81-bb52-e4291263d39a" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c7b6a3-35d1-4e26-954e-9366b9bc5adc]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:04 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f" returned: 0 in 1.006s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:40:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:04 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 Jul 05 02:40:04 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:04 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a Jul 05 02:40:04 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:05 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.007s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:40:05 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Deleted volume successfully. Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0263b0e6-8c99-472d-8a0b-5047aabb6588 tempest-VolumesListAdminTestJSON-1910639366 None] Lock "cinder-fb7a15a5-265d-424a-a1c2-fbbddd46f7a6-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:05 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:40:05 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:05 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.253s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:40:05 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Deleted volume successfully. Jul 05 02:40:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18b84506-f8c9-4d5d-8ef9-6b746b94c817 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-d0b26cb7-c61b-44fa-bc6b-4f4f8b68a3a4-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:06 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a" returned: 0 in 1.668s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:06 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a Jul 05 02:40:06 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:06 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.419s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:40:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:40:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 8 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:40:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:40:07 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6c6f3af-789b-4e81-bb52-e4291263d39a" returned: 0 in 1.643s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-quobyte-a6c6f3af-789b-4e81-bb52-e4291263d39a" released by "delete_volume" :: held 3.375s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:07 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Created reservations ['791881ac-65c0-4134-b071-867147294f1f', 'dc12bbe8-d72f-4cc6-87b0-791072dbfb5e', '31f9953b-b386-41fc-b100-2f19570c4b64', 'a279955a-2e38-4464-bd98-4923f9d9ad98'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:08 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:40:08 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "cinder-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "cinder-quobyte-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-quobyte-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da" acquired by "delete_volume" :: waited 0.044s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:09 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:09 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d414cf-8f78-4c60-b7f2-70b05fa564d0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.874s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:10 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:40:10 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Deleted volume successfully. Jul 05 02:40:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-32655bf8-a2ec-4a68-ac93-480e86badae7 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-a6c6f3af-789b-4e81-bb52-e4291263d39a-delete_volume" released by "delete_volume" :: held 5.708s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:10 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da Jul 05 02:40:10 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Flow 'volume_create_manager' (9c9c2500-6a7f-4c24-859d-b073a855acf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c4f94e-81bd-4c9e-919c-b9a5c033ea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c4f94e-81bd-4c9e-919c-b9a5c033ea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1928507054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7faeb3ed-ad05-49bf-94cb-6d2114a9f038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850e9a6f02cf4d3cb381972d18b854f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:11Z,use_quota=True,user_id='e5a032579f58459cbde358364ddae477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c2542e-f49e-499c-923a-b074a1a57dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c2542e-f49e-499c-923a-b074a1a57dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857ef56a-de86-4833-a911-6611ba1c4042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857ef56a-de86-4833-a911-6611ba1c4042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7faeb3ed-ad05-49bf-94cb-6d2114a9f038', 'volume_name': 'volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0efc5ff-7deb-4fe1-887f-d6079ddc3d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0efc5ff-7deb-4fe1-887f-d6079ddc3d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0c86c9-023d-4f87-91fd-fd6d8a7f8b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Volume 7faeb3ed-ad05-49bf-94cb-6d2114a9f038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038', 'volume_size': 1} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:11 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da" returned: 0 in 1.970s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:11 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da Jul 05 02:40:11 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:11 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381" returned: 0 in 7.386s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[271f425f-c1f0-4c9c-bad2-ae240fc194a8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:12 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f Jul 05 02:40:12 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:12 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da" returned: 0 in 0.765s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-quobyte-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da" released by "delete_volume" :: held 2.862s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Created reservations ['fd0f6231-461d-449c-9885-47347ecafaad', 'b49990f6-18fc-448f-aa70-b72bbe358c4f', 'ea7ade97-ed57-439c-b27a-f3659ebd690a', '3ec4ed53-daf8-46fa-8e94-d3246bf89f30'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:12 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:40:12 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:13 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f" returned: 0 in 1.080s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:40:13 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Converted 1024.00 MB image at 138.62 MB/s Jul 05 02:40:13 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:13 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 Jul 05 02:40:13 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:13 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.791s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:40:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Deleted volume successfully. Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc483ed2-ecc9-488c-b0a2-907b1c792e34 tempest-VolumesListAdminTestJSON-1353222677 None] Lock "cinder-99627a6e-ef25-4fbe-9ad9-6d6e3f4591da-delete_volume" released by "delete_volume" :: held 4.067s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:13 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381" returned: 0 in 0.833s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-27784b8e-921f-491a-aa84-f2e428db8381" released by "_copy_volume_from_snapshot" :: held 11.473s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-141373c4-564a-442d-b533-587e66ccf171-27784b8e-921f-491a-aa84-f2e428db8381" released by "_create_volume_from_snapshot" :: held 11.540s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.578s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.583s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1928507054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7faeb3ed-ad05-49bf-94cb-6d2114a9f038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850e9a6f02cf4d3cb381972d18b854f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:11Z,use_quota=True,user_id='e5a032579f58459cbde358364ddae477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Creating volume 7faeb3ed-ad05-49bf-94cb-6d2114a9f038 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:40:13 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:40:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:14 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 1073741824 Jul 05 02:40:14 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:14 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-53fec845-b977-4951-8567-84217a034a7f tempest-GroupSnapshotsTest-2146552497 None] Create group from source-snapshot-435cb7ed-9748-414a-9a5b-d26a63df1698 completed successfully. Jul 05 02:40:15 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 1073741824" returned: 0 in 1.070s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:15 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 Jul 05 02:40:15 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-27784b8e-921f-491a-aa84-f2e428db8381" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-27784b8e-921f-491a-aa84-f2e428db8381" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:15 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1fa609-8383-4c5b-88a4-ed1470539beb]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:15 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 Jul 05 02:40:15 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:16 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038" returned: 0 in 0.977s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:40:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0c86c9-023d-4f87-91fd-fd6d8a7f8b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f992e93d-08f3-425a-ab81-b766d5cc4ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:16 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Volume volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 (7faeb3ed-ad05-49bf-94cb-6d2114a9f038): created successfully Jul 05 02:40:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f992e93d-08f3-425a-ab81-b766d5cc4ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Flow 'volume_create_manager' (9c9c2500-6a7f-4c24-859d-b073a855acf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:16 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b40153f5-79c4-401b-b7d0-9971e94ea2b4 tempest-AttachVolumeNegativeTest-149954460 None] Created volume successfully. Jul 05 02:40:16 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381" returned: 0 in 0.940s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:16 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381 Jul 05 02:40:16 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:17 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-27784b8e-921f-491a-aa84-f2e428db8381" returned: 0 in 0.699s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-27784b8e-921f-491a-aa84-f2e428db8381" released by "delete_volume" :: held 1.704s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:17 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['d6104faa-7248-4135-aadc-d9485c538b7b'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:17 devstack cinder-volume[86671]: WARNING cinder.quota [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-331048918 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-331048918, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:40:17 devstack cinder-volume[86671]: WARNING cinder.quota [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-331048918 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-331048918, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:40:17 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['7ca6e964-0dc6-4b2b-84e8-3b0e3783606a', 'd9d4e7b0-1e6c-4ff8-9b89-68be7900bf51', '2d8028e6-1030-41d0-86ef-cc7d832108f6', '9100432b-f951-454f-928a-fa20670ba260'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:17 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:40:17 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 435cb7ed-9748-414a-9a5b-d26a63df1698: deleting Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 435cb7ed-9748-414a-9a5b-d26a63df1698: deleting {{(pid=86671) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4352}} Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-82982ce6-33fc-4b10-8e73-761ff4c3242f" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-82982ce6-33fc-4b10-8e73-761ff4c3242f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-141373c4-564a-442d-b533-587e66ccf171" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-141373c4-564a-442d-b533-587e66ccf171" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Deleting offline snapshot 141373c4-564a-442d-b533-587e66ccf171 of volume 82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] snapshot_file for this snap is: volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccb4ad3-0a9a-41dc-85a1-d18f9e1994dd]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:18 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.747s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:18 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:40:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1442b7d6-ceb3-4ab3-be73-48eaec24f6af tempest-GroupSnapshotsTest-2146552497 None] Delete group completed successfully. Jul 05 02:40:18 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 Jul 05 02:40:18 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:19 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171" returned: 0 in 0.915s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82982ce6-33fc-4b10-8e73-761ff4c3242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:40:19 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31b9521-b58e-4263-8357-9e607a1e3884]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:19 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f Jul 05 02:40:19 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-5c29b648-55be-4a11-85ab-cfec42a16a47 req-2ab2c290-48f0-43ad-bd5b-19f06ae764af tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-5c29b648-55be-4a11-85ab-cfec42a16a47 req-2ab2c290-48f0-43ad-bd5b-19f06ae764af tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:19 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898498e-2cdc-4aca-80d0-94fb43fe4763]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-5c29b648-55be-4a11-85ab-cfec42a16a47 req-2ab2c290-48f0-43ad-bd5b-19f06ae764af tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:19 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 Jul 05 02:40:19 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:20 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f" returned: 0 in 0.939s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:20 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 Jul 05 02:40:20 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:20 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-5c29b648-55be-4a11-85ab-cfec42a16a47 req-2ab2c290-48f0-43ad-bd5b-19f06ae764af tempest-AttachVolumeNegativeTest-149954460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038" returned: 0 in 0.858s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-5c29b648-55be-4a11-85ab-cfec42a16a47 req-2ab2c290-48f0-43ad-bd5b-19f06ae764af tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.886s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-5c29b648-55be-4a11-85ab-cfec42a16a47 req-2ab2c290-48f0-43ad-bd5b-19f06ae764af tempest-AttachVolumeNegativeTest-149954460 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4e8b08a-a257-4d6d-9104-37591a7255b7', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:40:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-5c29b648-55be-4a11-85ab-cfec42a16a47 req-2ab2c290-48f0-43ad-bd5b-19f06ae764af tempest-AttachVolumeNegativeTest-149954460 None] attachment_update completed successfully. Jul 05 02:40:21 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171" returned: 0 in 0.803s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:21 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171 Jul 05 02:40:21 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:21 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f.141373c4-564a-442d-b533-587e66ccf171" returned: 0 in 0.789s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-141373c4-564a-442d-b533-587e66ccf171" released by "_delete_snapshot" :: held 3.565s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-82982ce6-33fc-4b10-8e73-761ff4c3242f" released by "delete_snapshot" :: held 3.593s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:21 devstack cinder-volume[86671]: WARNING cinder.quota [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-331048918 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-331048918, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:40:21 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['4a8b63cb-f582-4876-97de-1c4c4f6cf72c', '9b51cbf8-6f06-4bf6-84b8-dd0dc4f142ce', '9d2d1758-f401-406f-b2d0-192725664821', '7d8c83f1-5692-45de-939c-192033141b78'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:22 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0b6f35d1-a6d0-45ed-a612-d5f3527b11c2 tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 435cb7ed-9748-414a-9a5b-d26a63df1698: deleted successfully Jul 05 02:40:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-82982ce6-33fc-4b10-8e73-761ff4c3242f" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-82982ce6-33fc-4b10-8e73-761ff4c3242f" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:23 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[11deb021-af4d-4452-9672-68ebc2b60ed2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:23 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f Jul 05 02:40:23 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:24 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f" returned: 0 in 0.988s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:24 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f Jul 05 02:40:24 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:24 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82982ce6-33fc-4b10-8e73-761ff4c3242f" returned: 0 in 0.810s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-82982ce6-33fc-4b10-8e73-761ff4c3242f" released by "delete_volume" :: held 1.885s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:24 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['85fbc675-520d-45ee-902e-6b41c28b2abd'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:25 devstack cinder-volume[86671]: WARNING cinder.db.sqlalchemy.api [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-331048918'] Jul 05 02:40:25 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['e340d45b-dcde-4773-b806-9116a1c12b86', 'aed4dd4b-664e-4046-b408-4d816f95b631', 'c5525bd1-01de-4bea-af74-135ec9135ca5', 'e331067e-482b-48f0-81bd-ca417b619d8c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:25 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:40:25 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:25 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.714s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:25 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:40:25 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0edc9c52-15b8-48f5-9912-8a4ffd12e7bf tempest-GroupSnapshotsTest-2146552497 None] Delete group completed successfully. Jul 05 02:40:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-817e25a0-faed-4c4f-a47c-ef1de1ea4faf tempest-GroupSnapshotsTest-2146552497 None] Group tempest-GroupSnapshotsTest-Group-514803991: creating Jul 05 02:40:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-817e25a0-faed-4c4f-a47c-ef1de1ea4faf tempest-GroupSnapshotsTest-2146552497 None] Group tempest-GroupSnapshotsTest-Group-514803991: created successfully Jul 05 02:40:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-817e25a0-faed-4c4f-a47c-ef1de1ea4faf tempest-GroupSnapshotsTest-2146552497 None] Create group completed successfully. Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Flow 'volume_create_manager' (d7030e91-d55a-44aa-a737-15bba242def8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f413eb71-4223-4fac-8d24-cc64b82f87af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f413eb71-4223-4fac-8d24-cc64b82f87af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2031213181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed0ecf2-474e-4c63-8188-95e9f9fcd66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490043c2994b40ed94ec2d32f8e2757d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:27Z,use_quota=True,user_id='7cefb0c929ac4a599ef2eeba4c951e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff88d04-578d-4d85-8f9f-b267b5794f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff88d04-578d-4d85-8f9f-b267b5794f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fcb421-d353-48fb-b3cd-0ea47669d651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fcb421-d353-48fb-b3cd-0ea47669d651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed0ecf2-474e-4c63-8188-95e9f9fcd66b', 'volume_name': 'volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2c8f00-f618-41ea-a3b6-1354009b4133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2c8f00-f618-41ea-a3b6-1354009b4133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d736c08-6fa0-45db-a34b-4c4346b21c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:27 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Volume 2ed0ecf2-474e-4c63-8188-95e9f9fcd66b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b', 'volume_size': 1} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2031213181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed0ecf2-474e-4c63-8188-95e9f9fcd66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490043c2994b40ed94ec2d32f8e2757d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:27Z,use_quota=True,user_id='7cefb0c929ac4a599ef2eeba4c951e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Creating volume 2ed0ecf2-474e-4c63-8188-95e9f9fcd66b {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:40:27 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:27 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b 1073741824 Jul 05 02:40:27 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Flow 'volume_create_manager' (38777d85-53be-42a3-9fb4-d72fd320a534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d7d288-48d7-4c66-b29f-6b1aaaac64af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d7d288-48d7-4c66-b29f-6b1aaaac64af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1956767337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61999bf4-9fa1-47bb-9a8d-3de91358dba2,host='devstack@QuobyteHD#QuobyteHD',id=1d7523d2-f384-4159-b8f7-95ccc1f76b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62e0725244483e993e47d328143032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:28Z,use_quota=True,user_id='d4e3df42b954442087a85704741e5303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e209aeb-2599-4d08-8584-7f30f481c969),volume_type_id=7e209aeb-2599-4d08-8584-7f30f481c969)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08614a57-de09-44ac-8066-f35f58690e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08614a57-de09-44ac-8066-f35f58690e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506493c0-d071-4a5a-b378-70a51f4b6ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506493c0-d071-4a5a-b378-70a51f4b6ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d7523d2-f384-4159-b8f7-95ccc1f76b7b', 'volume_name': 'volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75fc326-0d60-4b71-b3a9-9ab3a51b1da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75fc326-0d60-4b71-b3a9-9ab3a51b1da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6946c864-d9f7-4eb7-b0e5-d93fb8385157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:27 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Volume 1d7523d2-f384-4159-b8f7-95ccc1f76b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b', 'volume_size': 1} Jul 05 02:40:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:28 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b 1073741824" returned: 0 in 1.128s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:28 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b Jul 05 02:40:28 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:29 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b" returned: 0 in 0.940s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61999bf4-9fa1-47bb-9a8d-3de91358dba2,created_at=2026-07-05T00:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1956767337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61999bf4-9fa1-47bb-9a8d-3de91358dba2,host='devstack@QuobyteHD#QuobyteHD',id=1d7523d2-f384-4159-b8f7-95ccc1f76b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62e0725244483e993e47d328143032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:28Z,use_quota=True,user_id='d4e3df42b954442087a85704741e5303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e209aeb-2599-4d08-8584-7f30f481c969),volume_type_id=7e209aeb-2599-4d08-8584-7f30f481c969)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Creating volume 1d7523d2-f384-4159-b8f7-95ccc1f76b7b {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:40:29 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:29 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b 1073741824 Jul 05 02:40:29 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d736c08-6fa0-45db-a34b-4c4346b21c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4103cfda-45e5-4127-961e-138daea28dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:29 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Volume volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b (2ed0ecf2-474e-4c63-8188-95e9f9fcd66b): created successfully Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4103cfda-45e5-4127-961e-138daea28dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Flow 'volume_create_manager' (d7030e91-d55a-44aa-a737-15bba242def8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:29 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:INSERT=24,cinder:UPDATE=108,cinder:SELECT=95,cinder:DELETE=5 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:40:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a44d303c-67e4-4db9-af0b-b388eb19b4f1 tempest-VolumesTransfersV355Test-1050556877 None] Created volume successfully. Jul 05 02:40:30 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b 1073741824" returned: 0 in 1.053s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:30 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b Jul 05 02:40:30 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-63b10dc8-cf8e-483d-af27-b6585ff467ff tempest-VolumesTransfersV355Test-1452094349 None] Transfer volume completed successfully. Jul 05 02:40:31 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" returned: 0 in 0.779s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:40:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:31 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=86,cinder:INSERT=24,cinder:UPDATE=108,cinder:DELETE=8 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:40:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6946c864-d9f7-4eb7-b0e5-d93fb8385157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53042977-2a6f-41d7-8718-7695e8c8d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:31 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Volume volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b (1d7523d2-f384-4159-b8f7-95ccc1f76b7b): created successfully Jul 05 02:40:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53042977-2a6f-41d7-8718-7695e8c8d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Flow 'volume_create_manager' (38777d85-53be-42a3-9fb4-d72fd320a534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-222be30b-ba59-4d8b-adcf-a7dd67526905 tempest-GroupSnapshotsTest-2146552497 None] Created volume successfully. Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Acquiring lock "cinder-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Lock "cinder-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Flow 'volume_create_manager' (b4a0a36e-9bc9-4c8d-af83-5a278beb1db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd3d0a5-d196-43ed-9480-47434510f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Acquiring lock "cinder-quobyte-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd3d0a5-d196-43ed-9480-47434510f260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1437434427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61999bf4-9fa1-47bb-9a8d-3de91358dba2,host='devstack@QuobyteHD#QuobyteHD',id=083a1ec0-d74b-4be4-8577-9ec46e258fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62e0725244483e993e47d328143032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:32Z,use_quota=True,user_id='d4e3df42b954442087a85704741e5303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e209aeb-2599-4d08-8584-7f30f481c969),volume_type_id=7e209aeb-2599-4d08-8584-7f30f481c969)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6ada37-54b9-44ab-8ee7-0a929662a9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6ada37-54b9-44ab-8ee7-0a929662a9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed2b2b1-99ab-4466-b89a-c2da19c61eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed2b2b1-99ab-4466-b89a-c2da19c61eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083a1ec0-d74b-4be4-8577-9ec46e258fd1', 'volume_name': 'volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc194b5a-b042-4dcd-ac1e-6e39cc0c0f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc194b5a-b042-4dcd-ac1e-6e39cc0c0f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bd98d0-0401-4657-aa8a-4d1d097c618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:32 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Volume 083a1ec0-d74b-4be4-8577-9ec46e258fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1', 'volume_size': 1} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61999bf4-9fa1-47bb-9a8d-3de91358dba2,created_at=2026-07-05T00:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1437434427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61999bf4-9fa1-47bb-9a8d-3de91358dba2,host='devstack@QuobyteHD#QuobyteHD',id=083a1ec0-d74b-4be4-8577-9ec46e258fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62e0725244483e993e47d328143032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:32Z,use_quota=True,user_id='d4e3df42b954442087a85704741e5303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e209aeb-2599-4d08-8584-7f30f481c969),volume_type_id=7e209aeb-2599-4d08-8584-7f30f481c969)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Creating volume 083a1ec0-d74b-4be4-8577-9ec46e258fd1 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:40:32 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Lock "cinder-quobyte-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b" acquired by "delete_volume" :: waited 0.101s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:32 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 1073741824 Jul 05 02:40:32 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac06dc70-ecf6-4e88-b16f-ab52307c57ce]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:32 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b Jul 05 02:40:32 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:33 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b" returned: 0 in 0.968s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:33 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b Jul 05 02:40:33 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:33 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 1073741824" returned: 0 in 1.182s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:33 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 Jul 05 02:40:33 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:34 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b" returned: 0 in 0.843s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Lock "cinder-quobyte-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b" released by "delete_volume" :: held 1.884s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Created reservations ['a3b9a49d-9fe1-47dd-b097-e6e6c2bab585', 'ae8cbfa8-76ee-45d1-9abe-b211db886846', '09c1be7f-9a38-4d80-a4a7-24220d8b8a1f', '3f8807ef-b775-4772-85e4-076ca2bac136'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:34 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:40:34 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:34 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1" returned: 0 in 1.286s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] <== create_volume: return (2542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.544s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bd98d0-0401-4657-aa8a-4d1d097c618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285eb711-90e8-4e8a-a854-bea851681c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:34 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Volume volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 (083a1ec0-d74b-4be4-8577-9ec46e258fd1): created successfully Jul 05 02:40:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285eb711-90e8-4e8a-a854-bea851681c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Flow 'volume_create_manager' (b4a0a36e-9bc9-4c8d-af83-5a278beb1db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-374c3b03-c111-4989-bafa-977b28931c0e tempest-GroupSnapshotsTest-2146552497 None] Created volume successfully. Jul 05 02:40:35 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:40:35 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Flow 'volume_create_manager' (6b87a5db-56a6-41b7-9f27-ad3e764b64d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc489ec3-0a2d-4d74-a611-6374be3c9b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.472s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:35 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:40:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Deleted volume successfully. Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc489ec3-0a2d-4d74-a611-6374be3c9b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1439073682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a40d983-bbc9-46a8-89aa-f286c0bdca8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490043c2994b40ed94ec2d32f8e2757d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:36Z,use_quota=True,user_id='7cefb0c929ac4a599ef2eeba4c951e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2979bd74-4a7c-4e0b-a2ee-bc18de684143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2979bd74-4a7c-4e0b-a2ee-bc18de684143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f14ed5e-6880-4c08-a97c-f8a090161a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f14ed5e-6880-4c08-a97c-f8a090161a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a40d983-bbc9-46a8-89aa-f286c0bdca8e', 'volume_name': 'volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a9fde3-a93b-44b4-b522-7518420f5b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a9fde3-a93b-44b4-b522-7518420f5b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de58faf-0f40-48af-aec4-1b0cacd2d3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:36 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Volume 6a40d983-bbc9-46a8-89aa-f286c0bdca8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e', 'volume_size': 1} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1439073682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a40d983-bbc9-46a8-89aa-f286c0bdca8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490043c2994b40ed94ec2d32f8e2757d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:36Z,use_quota=True,user_id='7cefb0c929ac4a599ef2eeba4c951e95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Creating volume 6a40d983-bbc9-46a8-89aa-f286c0bdca8e {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:40:36 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9146fb00-45dd-4e62-8fc1-715e153acffc tempest-VolumesTransfersV355Test-1881109553 None] Lock "cinder-2ed0ecf2-474e-4c63-8188-95e9f9fcd66b-delete_volume" released by "delete_volume" :: held 3.912s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:36 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e 1073741824 Jul 05 02:40:36 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-708a7b0d-c934-4829-a0c4-fe6699fbc1d6 tempest-GroupSnapshotsTest-2146552497 None] Update group completed successfully. Jul 05 02:40:37 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e 1073741824" returned: 0 in 1.556s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:37 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e Jul 05 02:40:37 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:37 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-33cd9214-e5e4-4231-a5bd-5ee2c405cb61 tempest-GroupSnapshotsTest-2146552497 None] Update group completed successfully. Jul 05 02:40:38 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e" returned: 0 in 0.750s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] <== create_volume: return (2360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:40:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.363s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de58faf-0f40-48af-aec4-1b0cacd2d3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb44c42-2f54-4709-8173-e876e872f2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:38 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Volume volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e (6a40d983-bbc9-46a8-89aa-f286c0bdca8e): created successfully Jul 05 02:40:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb44c42-2f54-4709-8173-e876e872f2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Flow 'volume_create_manager' (6b87a5db-56a6-41b7-9f27-ad3e764b64d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:38 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-62f9512f-bddd-4959-a5d0-f4ebc1434f29 tempest-VolumesTransfersV355Test-1050556877 None] Created volume successfully. Jul 05 02:40:39 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a73724e1-7842-45cc-b021-9e08619bf3b8 tempest-GroupSnapshotsTest-2146552497 None] Update group completed successfully. Jul 05 02:40:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Acquiring lock "cinder-6a40d983-bbc9-46a8-89aa-f286c0bdca8e-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Lock "cinder-6a40d983-bbc9-46a8-89aa-f286c0bdca8e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Acquiring lock "cinder-quobyte-6a40d983-bbc9-46a8-89aa-f286c0bdca8e" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Lock "cinder-quobyte-6a40d983-bbc9-46a8-89aa-f286c0bdca8e" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:39 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c375b69b-66fc-472d-81b5-2fd570892cc2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:39 devstack sudo[91758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e Jul 05 02:40:39 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:40 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e" returned: 0 in 0.903s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:40 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e Jul 05 02:40:40 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-31ea251e-d0cc-4315-ad15-2384cc50a248 tempest-GroupSnapshotsTest-2146552497 None] Update group completed successfully. Jul 05 02:40:41 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a40d983-bbc9-46a8-89aa-f286c0bdca8e" returned: 0 in 0.987s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Lock "cinder-quobyte-6a40d983-bbc9-46a8-89aa-f286c0bdca8e" released by "delete_volume" :: held 1.984s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:41 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Created reservations ['bbcb3578-e8ca-4770-b3f1-b6cd2248bf59', '2f3ba9d9-cf78-42ef-8fb0-80ca5b753b80', '0db5d9f4-b411-412a-9d06-44e929330ae0', '212e6ab8-2b96-4c07-bbb4-0c67ed014928'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:40:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:41 devstack sudo[91810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:40:41 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:42 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] GroupSnapshot 0f84cb7b-59e2-46f1-a7d1-4f42cd6e4ad9: creating. Jul 05 02:40:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Group snapshot 0f84cb7b-59e2-46f1-a7d1-4f42cd6e4ad9: creating. {{(pid=86671) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4177}} Jul 05 02:40:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Creating offline snapshot 23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 of volume 083a1ec0-d74b-4be4-8577-9ec46e258fd1 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:40:42 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c6281b-cec7-4a1e-994f-ecdbcc264999]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:43 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 Jul 05 02:40:43 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:43 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.957s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:43 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:40:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Deleted volume successfully. Jul 05 02:40:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc0ea46d-e5fb-40bc-87f5-5ff8f2d81490 tempest-VolumesTransfersV355Test-1881109553 None] Lock "cinder-6a40d983-bbc9-46a8-89aa-f286c0bdca8e-delete_volume" released by "delete_volume" :: held 4.458s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:40:44 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1" returned: 0 in 1.559s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:44 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 1G Jul 05 02:40:44 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:45 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 1G" returned: 0 in 1.185s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:45 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 Jul 05 02:40:45 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:46 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8" returned: 0 in 1.116s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:46 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:40:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:46 devstack sudo[91908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 Jul 05 02:40:46 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:47 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8" returned: 0 in 0.850s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:47 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.info Jul 05 02:40:47 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:48 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.info" returned: 0 in 1.079s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:48 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:40:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:48 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.info Jul 05 02:40:48 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:49 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.info" returned: 0 in 0.960s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.925s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Creating offline snapshot b083659b-ce8b-4110-92fb-073201f58d64 of volume 1d7523d2-f384-4159-b8f7-95ccc1f76b7b {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:40:49 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad85519f-1281-4e95-914e-dd65d56c6994]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:49 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b Jul 05 02:40:49 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:51 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" returned: 0 in 1.310s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:51 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 1G Jul 05 02:40:51 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:52 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 1G" returned: 0 in 1.276s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:52 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 Jul 05 02:40:52 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:52 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Flow 'volume_create_manager' (08d6f19e-0ce6-4c0d-b05f-892be7eae217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3f71b3-580e-442d-b1ef-024bf0ed0106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3f71b3-580e-442d-b1ef-024bf0ed0106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1654229535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d00975-5bc5-4b07-8080-e9d41ae9261e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee339a75970241b595f911db1ccbe49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:53Z,use_quota=True,user_id='18695d7f33754ad19451be1d957d278d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b0192d-b03f-4934-a1ea-83b15ec4aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b0192d-b03f-4934-a1ea-83b15ec4aadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b58ef83-0071-4427-8aec-ee0e15d4db97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b58ef83-0071-4427-8aec-ee0e15d4db97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d00975-5bc5-4b07-8080-e9d41ae9261e', 'volume_name': 'volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06edf073-b7ac-4381-bd9c-5194e052ceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06edf073-b7ac-4381-bd9c-5194e052ceb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108a5588-2e74-4bf0-bed8-f12926d6f9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:53 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Volume b3d00975-5bc5-4b07-8080-e9d41ae9261e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e', 'volume_size': 1} Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:53 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64" returned: 0 in 1.374s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:53 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:40:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:53 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 Jul 05 02:40:53 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:54 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64" returned: 0 in 0.878s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:54 devstack sudo[92042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.info Jul 05 02:40:54 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:55 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.info" returned: 0 in 1.023s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:55 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:40:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:55 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.info Jul 05 02:40:55 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:56 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.info" returned: 0 in 0.801s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.791s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.355s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1654229535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d00975-5bc5-4b07-8080-e9d41ae9261e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee339a75970241b595f911db1ccbe49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:40:53Z,use_quota=True,user_id='18695d7f33754ad19451be1d957d278d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Creating volume b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:40:56 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:40:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:56 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e 1073741824 Jul 05 02:40:56 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a42be0e5-55da-435f-b6fa-c9d1ba46e5b1 tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 0f84cb7b-59e2-46f1-a7d1-4f42cd6e4ad9: created successfully Jul 05 02:40:57 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e 1073741824" returned: 0 in 1.335s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 0f84cb7b-59e2-46f1-a7d1-4f42cd6e4ad9: deleting Jul 05 02:40:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:57 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e Jul 05 02:40:57 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 0f84cb7b-59e2-46f1-a7d1-4f42cd6e4ad9: deleting {{(pid=86671) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4352}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-083a1ec0-d74b-4be4-8577-9ec46e258fd1" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-083a1ec0-d74b-4be4-8577-9ec46e258fd1" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-23db26c2-af35-4a5c-87b7-9ed3fba4a3e8" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-23db26c2-af35-4a5c-87b7-9ed3fba4a3e8" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Deleting offline snapshot 23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 of volume 083a1ec0-d74b-4be4-8577-9ec46e258fd1 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] snapshot_file for this snap is: volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedac6f3-f972-4050-8a74-82265c596ee2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:58 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 Jul 05 02:40:58 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:40:58 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e" returned: 0 in 0.877s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108a5588-2e74-4bf0-bed8-f12926d6f9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18030381-35d9-4b7c-8cb2-0b6aa0ed072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:40:58 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Volume volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e (b3d00975-5bc5-4b07-8080-e9d41ae9261e): created successfully Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18030381-35d9-4b7c-8cb2-0b6aa0ed072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:40:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Flow 'volume_create_manager' (08d6f19e-0ce6-4c0d-b05f-892be7eae217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:40:58 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-71d2cd18-4da4-428e-b423-96a761de1342 tempest-VolumesCloneTest-1692399990 None] Created volume successfully. Jul 05 02:40:59 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Jul 05 02:40:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8" returned: 0 in 0.976s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:40:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:40:59 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78fb9a5-16a5-49b8-83af-21e03115b10a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:40:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:40:59 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 Jul 05 02:40:59 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:41:00 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Flow 'volume_create_manager' (04981b1d-d5e5-4d00-b9c4-b05c036802ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085822c9-c08f-4049-b6a1-a8f59d3a7ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1" returned: 0 in 0.992s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085822c9-c08f-4049-b6a1-a8f59d3a7ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1557487477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee339a75970241b595f911db1ccbe49b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b3d00975-5bc5-4b07-8080-e9d41ae9261e,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:00Z,use_quota=True,user_id='18695d7f33754ad19451be1d957d278d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:00 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3aab3b8-e0bc-4355-a777-46fe943e835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:00 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3aab3b8-e0bc-4355-a777-46fe943e835d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bbad14-05a9-4c1f-a61a-85b34cb81857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bbad14-05a9-4c1f-a61a-85b34cb81857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b', 'volume_name': 'volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b', 'volume_size': 2, 'source_volid': 'b3d00975-5bc5-4b07-8080-e9d41ae9261e', 'source_volstatus': 'available'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8015582a-2007-41d6-9a2c-4c61c24ae60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8015582a-2007-41d6-9a2c-4c61c24ae60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee9853e-a5be-4029-a680-9695e9286fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:00 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Volume b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b', 'volume_size': 2, 'source_volid': 'b3d00975-5bc5-4b07-8080-e9d41ae9261e', 'source_volstatus': 'available'} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:00 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Cloning volume b3d00975-5bc5-4b07-8080-e9d41ae9261e to volume b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Creating offline snapshot aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b of volume b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9a856c-2552-4051-b08f-0f8c5d636daa]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:00 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e Jul 05 02:41:00 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:01 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8" returned: 0 in 0.786s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:01 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8 Jul 05 02:41:01 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:01 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e" returned: 0 in 0.797s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:01 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b 1G Jul 05 02:41:01 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:01 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1.23db26c2-af35-4a5c-87b7-9ed3fba4a3e8" returned: 0 in 0.680s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-23db26c2-af35-4a5c-87b7-9ed3fba4a3e8" released by "_delete_snapshot" :: held 3.603s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-083a1ec0-d74b-4be4-8577-9ec46e258fd1" released by "delete_snapshot" :: held 3.644s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-b083659b-ce8b-4110-92fb-073201f58d64" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-b083659b-ce8b-4110-92fb-073201f58d64" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Deleting offline snapshot b083659b-ce8b-4110-92fb-073201f58d64 of volume 1d7523d2-f384-4159-b8f7-95ccc1f76b7b {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] snapshot_file for this snap is: volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[753de215-950f-44d3-a920-fe79c5f6da10]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:01 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 Jul 05 02:41:01 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:02 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b 1G" returned: 0 in 0.883s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:02 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b Jul 05 02:41:02 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:02 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64" returned: 0 in 0.848s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:41:02 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdb8162-fd90-4aa2-9422-ee84ce3ea8c9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:02 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b" returned: 0 in 0.697s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:02 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b is being set with open permissions: ugo+rw Jul 05 02:41:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:02 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b Jul 05 02:41:02 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:02 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b Jul 05 02:41:02 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:03 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b" returned: 0 in 0.721s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:03 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" returned: 0 in 0.851s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:03 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 Jul 05 02:41:03 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:03 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.info Jul 05 02:41:03 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:04 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.info" returned: 0 in 0.775s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:04 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.info is being set with open permissions: ugo+rw Jul 05 02:41:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:04 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.info Jul 05 02:41:04 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:04 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64" returned: 0 in 0.854s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:04 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64 Jul 05 02:41:04 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:05 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.info" returned: 0 in 0.756s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Acquiring lock "cinder-quobyte-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Lock "cinder-quobyte-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] snapshot: aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b, volume: b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcb0a9c-2a0a-43bf-8e10-996cd5d743e3]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:05 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b.b083659b-ce8b-4110-92fb-073201f58d64" returned: 0 in 0.829s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:05 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:41:05 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-b083659b-ce8b-4110-92fb-073201f58d64" released by "_delete_snapshot" :: held 3.493s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" released by "delete_snapshot" :: held 3.518s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:05 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b Jul 05 02:41:05 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:05 devstack cinder-volume[86671]: WARNING cinder.quota [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-852193462 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-852193462, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:41:05 devstack cinder-volume[86671]: WARNING cinder.quota [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-852193462 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-852193462, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['558c6aa9-b652-419a-a598-a562d70f5bd0', '1e8a2ca4-ff80-4f5b-a06b-cd4acf284c88', 'f24e0078-627e-4571-bbfd-236dfa01b668', '5fa568ab-353f-4c55-b860-b4175599eabb'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:05 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['f4ff97f1-aa16-43f3-82cb-12478065a2e5', '538abf99-8354-4c42-9d60-b62f2d90050c', 'eb1cb231-a30a-4872-a11d-dcc7be84a227', 'a9ba7188-5e72-4bf9-98a7-ea0adab22226'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:05 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4a4563d0-fb6f-4350-ad91-22d29f36ec7a tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 0f84cb7b-59e2-46f1-a7d1-4f42cd6e4ad9: deleted successfully Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Flow 'volume_create_manager' (ce98cc90-9d14-4853-833a-5c31b5256b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84c0993-0e84-4985-b2e8-b05890a43c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84c0993-0e84-4985-b2e8-b05890a43c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-380584123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca557b3-9829-47a7-8922-45d0a0247d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7917c04b08fc451d9b8e1d00840f968d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:06Z,use_quota=True,user_id='5c1441216a484cf9bd9ce1286a154d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646dbcdc-30ca-4417-9478-371983b74f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646dbcdc-30ca-4417-9478-371983b74f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cef8bb-43f7-41f6-97fc-224d6be38dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:06 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05cef8bb-43f7-41f6-97fc-224d6be38dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca557b3-9829-47a7-8922-45d0a0247d66', 'volume_name': 'volume-aca557b3-9829-47a7-8922-45d0a0247d66', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366404ae-b26f-4ba5-b98e-04574fb40d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366404ae-b26f-4ba5-b98e-04574fb40d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ef1d6c-a941-4ebf-b818-98cb51c8f6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:06 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Volume aca557b3-9829-47a7-8922-45d0a0247d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca557b3-9829-47a7-8922-45d0a0247d66', 'volume_size': 1} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.915s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 8 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:41:06 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b" returned: 0 in 0.924s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaf70f5-3a0f-4007-a39b-adcc0e7075a8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:06 devstack sudo[92188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e Jul 05 02:41:06 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-083a1ec0-d74b-4be4-8577-9ec46e258fd1" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-083a1ec0-d74b-4be4-8577-9ec46e258fd1" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bef8aa-dc5e-4ee2-bb9c-b824d2d91735]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:06 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 Jul 05 02:41:06 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:06 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e" returned: 0 in 0.796s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:41:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:06 devstack sudo[92195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b Jul 05 02:41:06 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:07 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1" returned: 0 in 0.805s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:07 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1 Jul 05 02:41:07 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:07 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-083a1ec0-d74b-4be4-8577-9ec46e258fd1" returned: 0 in 0.683s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-083a1ec0-d74b-4be4-8577-9ec46e258fd1" released by "delete_volume" :: held 1.558s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" acquired by "delete_volume" :: waited 0.057s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:08 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87719ce-9650-4ca3-8996-6f5dd5857d3e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:08 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b Jul 05 02:41:08 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:09 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" returned: 0 in 1.783s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:09 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b Jul 05 02:41:09 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:11 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" returned: 0 in 1.439s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-1d7523d2-f384-4159-b8f7-95ccc1f76b7b" released by "delete_volume" :: held 3.375s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:11 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['1da28667-0546-40ee-b64c-4008229f232e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:11 devstack cinder-volume[86671]: WARNING cinder.quota [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-852193462 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-852193462, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:41:11 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['096f9312-7490-4579-8578-51546b33634c', 'd81eaa8c-7a56-4618-a236-a060bfead5ce', '1339d5c7-be62-417d-a3f5-3de0c11f43cb', '6986a17f-d503-4f7a-b9bd-417f3f143e5f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:12 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['b74d094f-9b8e-4577-a048-2c21ca31df96', '0d317f26-429a-42db-8315-5c03420414de', '3967df00-b770-44db-b143-8f01d22d0892', '02a7c0f8-3b5f-4750-8949-9761f6328eee'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:12 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:41:12 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:12 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b" returned: 0 in 6.001s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:12 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3963dc67-2162-4cbf-b517-508d14b44b2e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:13 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e Jul 05 02:41:13 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0911772d-3899-4964-b94e-5e21dc0e527f tempest-GroupSnapshotsTest-2146552497 None] Group tempest-GroupSnapshotsTest-Group-397791810: creating Jul 05 02:41:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0911772d-3899-4964-b94e-5e21dc0e527f tempest-GroupSnapshotsTest-2146552497 None] Group tempest-GroupSnapshotsTest-Group-397791810: created successfully Jul 05 02:41:13 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.028s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:13 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:41:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0911772d-3899-4964-b94e-5e21dc0e527f tempest-GroupSnapshotsTest-2146552497 None] Create group completed successfully. Jul 05 02:41:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2e4c88b9-fa96-4710-aeab-15d20ce0c505 tempest-GroupSnapshotsTest-2146552497 None] Delete group completed successfully. Jul 05 02:41:14 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e" returned: 0 in 1.293s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:14 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:41:14 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Converted 1024.00 MB image at 170.33 MB/s Jul 05 02:41:14 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b is being set with open permissions: ugo+rw Jul 05 02:41:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:14 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b Jul 05 02:41:14 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:15 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b" returned: 0 in 0.718s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Lock "cinder-quobyte-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b" released by "_copy_volume_from_snapshot" :: held 9.875s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Acquiring lock "cinder-quobyte-aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Lock "cinder-quobyte-aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Deleting offline snapshot aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b of volume b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] snapshot_file for this snap is: volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5ad537-dbfd-46f3-a376-276cfe1ccfb8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:15 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b Jul 05 02:41:15 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Flow 'volume_create_manager' (82ffcfa0-5e4a-4123-81ef-e336a5974672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bdb159-003c-4bc2-ad15-19b01791e4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bdb159-003c-4bc2-ad15-19b01791e4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1707438484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77c7dd1f-9d49-47c2-93a3-42db86ab5306,host='devstack@QuobyteHD#QuobyteHD',id=29a28a47-2c56-4714-abde-e5af4bfda0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62e0725244483e993e47d328143032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:15Z,use_quota=True,user_id='d4e3df42b954442087a85704741e5303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(773f208a-8777-4604-b1b7-e7543534d696),volume_type_id=773f208a-8777-4604-b1b7-e7543534d696)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5762e7f1-cab2-4ff7-9cbb-d2cc6f816f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5762e7f1-cab2-4ff7-9cbb-d2cc6f816f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e03204-6d1a-4e3a-941d-bd7fa1ea9115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e03204-6d1a-4e3a-941d-bd7fa1ea9115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a28a47-2c56-4714-abde-e5af4bfda0f3', 'volume_name': 'volume-29a28a47-2c56-4714-abde-e5af4bfda0f3', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1d7ce3-dfc3-4fdc-8b45-e649a65b5cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1d7ce3-dfc3-4fdc-8b45-e649a65b5cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57844c5-fca7-495d-81f2-1a5e8c69c9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:15 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Volume 29a28a47-2c56-4714-abde-e5af4bfda0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a28a47-2c56-4714-abde-e5af4bfda0f3', 'volume_size': 1} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:15 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b" returned: 0 in 0.795s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7987d02e-7679-4967-aba9-7ae972681225]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:16 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e Jul 05 02:41:16 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:16 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e" returned: 0 in 0.813s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:16 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b Jul 05 02:41:16 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:17 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b" returned: 0 in 0.770s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:17 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b Jul 05 02:41:17 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:18 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e.aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b" returned: 0 in 0.672s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Lock "cinder-quobyte-aebb1c7f-c8eb-41bc-836e-1ac0524ffe7b" released by "_delete_snapshot" :: held 3.141s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.888s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.134s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-380584123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca557b3-9829-47a7-8922-45d0a0247d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7917c04b08fc451d9b8e1d00840f968d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:06Z,use_quota=True,user_id='5c1441216a484cf9bd9ce1286a154d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Creating volume aca557b3-9829-47a7-8922-45d0a0247d66 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:41:18 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee9853e-a5be-4029-a680-9695e9286fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b', 'volume_size': 2, 'source_volid': 'b3d00975-5bc5-4b07-8080-e9d41ae9261e', 'source_volstatus': 'available'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:18 devstack sudo[92294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66 1073741824 Jul 05 02:41:18 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20263dd-fdef-4ee2-a3bd-4dfa964edbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:18 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Volume volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b (b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b): created successfully Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20263dd-fdef-4ee2-a3bd-4dfa964edbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Flow 'volume_create_manager' (04981b1d-d5e5-4d00-b9c4-b05c036802ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d695907e-4950-4761-861e-4cace4ed4d79 tempest-VolumesCloneTest-1692399990 None] Created volume successfully. Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Acquiring lock "cinder-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Lock "cinder-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Acquiring lock "cinder-quobyte-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Lock "cinder-quobyte-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d77bfe-6cbe-4de2-ab0a-6da6168a4554]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:19 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b Jul 05 02:41:19 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:19 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66 1073741824" returned: 0 in 1.012s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:19 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66 Jul 05 02:41:19 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:19 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b" returned: 0 in 0.838s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:19 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b Jul 05 02:41:19 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:19 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66" returned: 0 in 0.693s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.464s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=77c7dd1f-9d49-47c2-93a3-42db86ab5306,created_at=2026-07-05T00:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1707438484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=77c7dd1f-9d49-47c2-93a3-42db86ab5306,host='devstack@QuobyteHD#QuobyteHD',id=29a28a47-2c56-4714-abde-e5af4bfda0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f62e0725244483e993e47d328143032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:15Z,use_quota=True,user_id='d4e3df42b954442087a85704741e5303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(773f208a-8777-4604-b1b7-e7543534d696),volume_type_id=773f208a-8777-4604-b1b7-e7543534d696)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Creating volume 29a28a47-2c56-4714-abde-e5af4bfda0f3 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:41:20 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:20 devstack sudo[92311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 1073741824 Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ef1d6c-a941-4ebf-b818-98cb51c8f6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca557b3-9829-47a7-8922-45d0a0247d66', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:20 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb934ef4-9dd9-4205-b182-9f71bd8dde21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:20 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Volume volume-aca557b3-9829-47a7-8922-45d0a0247d66 (aca557b3-9829-47a7-8922-45d0a0247d66): created successfully Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb934ef4-9dd9-4205-b182-9f71bd8dde21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Flow 'volume_create_manager' (ce98cc90-9d14-4853-833a-5c31b5256b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9c970671-bb7a-4ea7-84c8-eb87a1086ff2 tempest-ServersNegativeTestJSON-1523456071 None] Created volume successfully. Jul 05 02:41:20 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b" returned: 0 in 0.722s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Lock "cinder-quobyte-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b" released by "delete_volume" :: held 1.619s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Created reservations ['dcd34835-ccf4-4a63-910c-b8082c2adddb', '6fe3edd0-544e-4cd2-a0ce-246553db001c', '3fc87d3d-791d-4a9b-a380-4c606df78e78', 'bb331fe7-2c66-422b-ad4c-c36986158b9a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:20 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:41:20 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-9e83bcf6-512c-42dc-82db-2d87ea0b852b req-cd4124e4-f3fe-4d67-af18-4a2258d89b58 tempest-AttachVolumeNegativeTest-149954460 None] Terminate volume connection completed successfully. Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-9e83bcf6-512c-42dc-82db-2d87ea0b852b req-cd4124e4-f3fe-4d67-af18-4a2258d89b58 tempest-AttachVolumeNegativeTest-149954460 None] Deleting attachment b4e8b08a-a257-4d6d-9104-37591a7255b7. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:41:20 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 1073741824" returned: 0 in 0.940s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:21 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 Jul 05 02:41:21 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Acquiring lock "cinder-b3d00975-5bc5-4b07-8080-e9d41ae9261e-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Lock "cinder-b3d00975-5bc5-4b07-8080-e9d41ae9261e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Acquiring lock "cinder-quobyte-b3d00975-5bc5-4b07-8080-e9d41ae9261e" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Lock "cinder-quobyte-b3d00975-5bc5-4b07-8080-e9d41ae9261e" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a87487-780d-4187-93bf-7f58ad623e44]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:21 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e Jul 05 02:41:21 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:21 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.784s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:41:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Deleted volume successfully. Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-460fb630-aa89-4768-a4a4-833aa97b1503 tempest-VolumesCloneTest-1692399990 None] Lock "cinder-b8367eed-eb5f-4b6a-acd4-c95dd4b9f81b-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:21 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3" returned: 0 in 0.706s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57844c5-fca7-495d-81f2-1a5e8c69c9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a28a47-2c56-4714-abde-e5af4bfda0f3', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fd80dc-7a4e-410f-bbd1-05a4e46178a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:21 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Volume volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 (29a28a47-2c56-4714-abde-e5af4bfda0f3): created successfully Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fd80dc-7a4e-410f-bbd1-05a4e46178a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Flow 'volume_create_manager' (82ffcfa0-5e4a-4123-81ef-e336a5974672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8849fd10-43bb-436a-be3b-1a9326826668 tempest-GroupSnapshotsTest-2146552497 None] Created volume successfully. Jul 05 02:41:22 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e" returned: 0 in 0.921s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:22 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e Jul 05 02:41:22 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:22 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] GroupSnapshot 7cb84ad7-9bdb-4ed6-8d12-e47155778085: creating. Jul 05 02:41:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Group snapshot 7cb84ad7-9bdb-4ed6-8d12-e47155778085: creating. {{(pid=86671) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4177}} Jul 05 02:41:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Creating offline snapshot 13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 of volume 29a28a47-2c56-4714-abde-e5af4bfda0f3 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:41:22 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[434dde04-be38-45f4-9358-f3da81d2f2c9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:41:23 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Flow 'volume_create_manager' (a8616100-9249-49fd-a03d-b39787b11186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a65e4e-9fb3-4abb-b740-04d6aa754d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:23 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 Jul 05 02:41:23 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3d00975-5bc5-4b07-8080-e9d41ae9261e" returned: 0 in 0.807s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a65e4e-9fb3-4abb-b740-04d6aa754d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1462308475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043a2d27-be01-44eb-b218-5390fdba8d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7917c04b08fc451d9b8e1d00840f968d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:23Z,use_quota=True,user_id='5c1441216a484cf9bd9ce1286a154d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed7d8f7-1032-4906-bf0d-c952bd616851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed7d8f7-1032-4906-bf0d-c952bd616851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b4af9-8f8c-4c6b-a137-0ca94c8e2acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b4af9-8f8c-4c6b-a137-0ca94c8e2acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '043a2d27-be01-44eb-b218-5390fdba8d14', 'volume_name': 'volume-043a2d27-be01-44eb-b218-5390fdba8d14', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebdbae0-71b8-4fa5-a740-5768371d69e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebdbae0-71b8-4fa5-a740-5768371d69e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0ebc55-4e6e-4a92-9799-6d8bfae88b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:23 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Volume 043a2d27-be01-44eb-b218-5390fdba8d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-043a2d27-be01-44eb-b218-5390fdba8d14', 'volume_size': 1} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Lock "cinder-quobyte-b3d00975-5bc5-4b07-8080-e9d41ae9261e" released by "delete_volume" :: held 1.848s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Created reservations ['e7f2f920-113e-4ed6-a923-f0cb4c28510a', '2f135760-dae9-418e-a2e2-bc65f5a8c423', 'eebe8a17-da56-4019-8b5e-7389827024ed', '88e4647c-cce7-480a-92f4-31a1258264fa'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:23 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:41:23 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:23 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3" returned: 0 in 0.995s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:23 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 1G Jul 05 02:41:23 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:23 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.750s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:23 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:41:23 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Deleted volume successfully. Jul 05 02:41:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a59b02-36aa-4e60-a48b-b565b8cf65bb tempest-VolumesCloneTest-1692399990 None] Lock "cinder-b3d00975-5bc5-4b07-8080-e9d41ae9261e-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:24 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 1G" returned: 0 in 0.989s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:24 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 Jul 05 02:41:24 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:25 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7" returned: 0 in 1.100s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:25 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:41:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:26 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 Jul 05 02:41:26 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:26 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7" returned: 0 in 0.734s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:26 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.info Jul 05 02:41:26 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Flow 'volume_create_manager' (f1bfe925-52ef-4847-860e-e97147ef5748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbda528b-28b8-427a-9176-1c82fc990b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbda528b-28b8-427a-9176-1c82fc990b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-237271632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bb9c10-9245-4525-ab75-bbee8de1d88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd6f4a5c1c241b2946d70eba8215bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:27Z,use_quota=True,user_id='0f3d85a0273847999c6e5c32b7825925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af6eec2-3f92-45ae-9e5e-c98cbe94a14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af6eec2-3f92-45ae-9e5e-c98cbe94a14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800e1b12-d941-455f-a054-347b2929bb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800e1b12-d941-455f-a054-347b2929bb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17bb9c10-9245-4525-ab75-bbee8de1d88c', 'volume_name': 'volume-17bb9c10-9245-4525-ab75-bbee8de1d88c', 'volume_size': 2}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46108405-4fdc-4e84-b68a-b6e0c5319ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46108405-4fdc-4e84-b68a-b6e0c5319ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db166a0-420b-45a9-8493-4e677223b05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:27 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Volume 17bb9c10-9245-4525-ab75-bbee8de1d88c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17bb9c10-9245-4525-ab75-bbee8de1d88c', 'volume_size': 2} Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:27 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.info" returned: 0 in 0.707s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:27 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:41:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:27 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.info Jul 05 02:41:27 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:28 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.info" returned: 0 in 0.674s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.325s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.077s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1462308475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043a2d27-be01-44eb-b218-5390fdba8d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7917c04b08fc451d9b8e1d00840f968d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:23Z,use_quota=True,user_id='5c1441216a484cf9bd9ce1286a154d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Creating volume 043a2d27-be01-44eb-b218-5390fdba8d14 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:41:28 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:41:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:28 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14 1073741824 Jul 05 02:41:28 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:28 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1689fa36-aa12-407d-aa05-f058af635a3f tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 7cb84ad7-9bdb-4ed6-8d12-e47155778085: created successfully Jul 05 02:41:29 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14 1073741824" returned: 0 in 0.832s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:29 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14 Jul 05 02:41:29 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 7cb84ad7-9bdb-4ed6-8d12-e47155778085: deleting Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 7cb84ad7-9bdb-4ed6-8d12-e47155778085: deleting {{(pid=86671) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4352}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-29a28a47-2c56-4714-abde-e5af4bfda0f3" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-29a28a47-2c56-4714-abde-e5af4bfda0f3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Deleting offline snapshot 13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 of volume 29a28a47-2c56-4714-abde-e5af4bfda0f3 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] snapshot_file for this snap is: volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e62b0c7-57d0-4026-9df0-11ad4d26bfbe]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:29 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 Jul 05 02:41:29 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:29 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14" returned: 0 in 0.713s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.317s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-237271632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17bb9c10-9245-4525-ab75-bbee8de1d88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd6f4a5c1c241b2946d70eba8215bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:27Z,use_quota=True,user_id='0f3d85a0273847999c6e5c32b7825925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Creating volume 17bb9c10-9245-4525-ab75-bbee8de1d88c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:41:29 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c 2147483648 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=96,cinder:SELECT=80,cinder:DELETE=9,cinder:INSERT=24 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:41:29 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c 2147483648 Jul 05 02:41:29 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0ebc55-4e6e-4a92-9799-6d8bfae88b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-043a2d27-be01-44eb-b218-5390fdba8d14', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e57f5d4-8a31-4674-853e-95883e5061c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:29 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Volume volume-043a2d27-be01-44eb-b218-5390fdba8d14 (043a2d27-be01-44eb-b218-5390fdba8d14): created successfully Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e57f5d4-8a31-4674-853e-95883e5061c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Flow 'volume_create_manager' (a8616100-9249-49fd-a03d-b39787b11186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e3314708-ca1c-4c5d-8339-75870e18ad33 tempest-ServersNegativeTestJSON-1523456071 None] Created volume successfully. Jul 05 02:41:30 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7" returned: 0 in 0.820s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a28a47-2c56-4714-abde-e5af4bfda0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:41:30 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8de415-d86b-4ec3-8e4f-cc50c2a40ac8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:30 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 Jul 05 02:41:30 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:30 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c 2147483648" returned: 0 in 1.121s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:30 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c Jul 05 02:41:30 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Acquiring lock "cinder-043a2d27-be01-44eb-b218-5390fdba8d14-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Lock "cinder-043a2d27-be01-44eb-b218-5390fdba8d14-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Acquiring lock "cinder-quobyte-043a2d27-be01-44eb-b218-5390fdba8d14" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Lock "cinder-quobyte-043a2d27-be01-44eb-b218-5390fdba8d14" acquired by "delete_volume" :: waited 0.036s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[929aa679-79f4-4dba-a816-91a6b16a6760]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:31 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14 Jul 05 02:41:31 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:31 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3" returned: 0 in 1.127s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:31 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 Jul 05 02:41:31 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:31 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c" returned: 0 in 0.864s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=105,cinder:UPDATE=103,cinder:INSERT=21,cinder:DELETE=2 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db166a0-420b-45a9-8493-4e677223b05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17bb9c10-9245-4525-ab75-bbee8de1d88c', 'volume_size': 2}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f15f52-6c34-4ffd-8e98-2147d217cf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:31 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Volume volume-17bb9c10-9245-4525-ab75-bbee8de1d88c (17bb9c10-9245-4525-ab75-bbee8de1d88c): created successfully Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f15f52-6c34-4ffd-8e98-2147d217cf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Flow 'volume_create_manager' (f1bfe925-52ef-4847-860e-e97147ef5748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-cc1193ed-b6c2-48e6-bc56-d2e40a8ca3d3 tempest-VolumesCloneNegativeTest-89399939 None] Created volume successfully. Jul 05 02:41:32 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14" returned: 0 in 0.928s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:32 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14 Jul 05 02:41:32 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:32 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7" returned: 0 in 0.938s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:32 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7 Jul 05 02:41:32 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Acquiring lock "cinder-17bb9c10-9245-4525-ab75-bbee8de1d88c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Lock "cinder-17bb9c10-9245-4525-ab75-bbee8de1d88c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:32 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-043a2d27-be01-44eb-b218-5390fdba8d14" returned: 0 in 0.759s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Lock "cinder-quobyte-043a2d27-be01-44eb-b218-5390fdba8d14" released by "delete_volume" :: held 1.751s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Acquiring lock "cinder-quobyte-17bb9c10-9245-4525-ab75-bbee8de1d88c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Lock "cinder-quobyte-17bb9c10-9245-4525-ab75-bbee8de1d88c" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c430b3-1d5d-4d47-ae9b-a7eeee23910e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Created reservations ['bf238eb2-e713-4b97-86f1-1c1d9c43d857', 'aecb0945-bb3b-417d-aaf2-a7768f794723', '4ab3019a-0f35-4718-a81b-f77578663835', '46a84781-4ce5-430b-a4d4-f1aadb3f5f74'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:33 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3.13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7" returned: 0 in 0.782s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:33 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:41:33 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:33 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c Jul 05 02:41:33 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-13090cb8-7c13-43d5-a30b-8b5ad3fbf7b7" released by "_delete_snapshot" :: held 3.812s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-29a28a47-2c56-4714-abde-e5af4bfda0f3" released by "delete_snapshot" :: held 3.838s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:33 devstack cinder-volume[86671]: WARNING cinder.quota [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2123761292 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2123761292, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:41:33 devstack cinder-volume[86671]: WARNING cinder.quota [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2123761292 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2123761292, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['174b40e8-3c94-4ed2-bfd9-cb8cc5b01b8b', '13b9abd9-f9d6-41f0-8a4f-451358a8bf3a', '570911b7-5cc1-4356-a7e6-7d5f70128c69', '309f5214-6e81-4d6b-994c-5e8a4b85e8fe'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1bac165c-3116-45ef-9131-cdf5473f055a tempest-GroupSnapshotsTest-2146552497 None] group_snapshot 7cb84ad7-9bdb-4ed6-8d12-e47155778085: deleted successfully Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Acquiring lock "cinder-aca557b3-9829-47a7-8922-45d0a0247d66-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Lock "cinder-aca557b3-9829-47a7-8922-45d0a0247d66-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Acquiring lock "cinder-quobyte-aca557b3-9829-47a7-8922-45d0a0247d66" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Lock "cinder-quobyte-aca557b3-9829-47a7-8922-45d0a0247d66" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c56427-1338-4cfe-9680-edac5965cd6d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:33 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66 Jul 05 02:41:33 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:34 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c" returned: 0 in 1.002s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:34 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.926s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:41:34 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Deleted volume successfully. Jul 05 02:41:34 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c Jul 05 02:41:34 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1c81c8b4-d888-434a-9f5e-8796c2281cab tempest-ServersNegativeTestJSON-1523456071 None] Lock "cinder-043a2d27-be01-44eb-b218-5390fdba8d14-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "cinder-quobyte-29a28a47-2c56-4714-abde-e5af4bfda0f3" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-29a28a47-2c56-4714-abde-e5af4bfda0f3" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b4d833-834e-405b-b616-6f79fa026240]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:34 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 Jul 05 02:41:34 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:34 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66" returned: 0 in 1.025s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:34 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66 Jul 05 02:41:34 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:35 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-17bb9c10-9245-4525-ab75-bbee8de1d88c" returned: 0 in 0.929s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Lock "cinder-quobyte-17bb9c10-9245-4525-ab75-bbee8de1d88c" released by "delete_volume" :: held 1.984s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Created reservations ['bbe4920d-a3b7-41f1-9b28-b73d61080178', 'bcd0b9ee-4335-4efe-84cb-4516f11a0459', 'ebcc980d-439a-439d-96e9-92e75a136a85', 'b1211306-3440-43ca-ac99-8eefb562755a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:35 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:41:35 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:35 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3" returned: 0 in 0.957s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:35 devstack sudo[92470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3 Jul 05 02:41:35 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:35 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-aca557b3-9829-47a7-8922-45d0a0247d66" returned: 0 in 0.965s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Lock "cinder-quobyte-aca557b3-9829-47a7-8922-45d0a0247d66" released by "delete_volume" :: held 2.068s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Created reservations ['1aaf8bd4-a4a7-4d68-9dbd-3da603091a76', 'b61d6129-a591-4a81-80b7-d6e2d409eb98', '295c2083-c737-4c50-97f9-f721f3ef3da0', '9b2207a4-14a6-4faf-ae82-cbeb23700d0d'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:35 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:41:35 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:36 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.936s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:41:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Deleted volume successfully. Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d1a73d72-a3db-434d-bdb6-afe173a153e2 tempest-VolumesCloneNegativeTest-89399939 None] Lock "cinder-17bb9c10-9245-4525-ab75-bbee8de1d88c-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:36 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-29a28a47-2c56-4714-abde-e5af4bfda0f3" returned: 0 in 0.885s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Lock "cinder-quobyte-29a28a47-2c56-4714-abde-e5af4bfda0f3" released by "delete_volume" :: held 1.919s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['32fcd413-2ab7-4b42-a417-7cef3135332e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:36 devstack cinder-volume[86671]: WARNING cinder.quota [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2123761292 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2123761292, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Created reservations ['d7628136-0488-4f9d-9943-c8858ad18b0e', '7940fa2d-a555-4512-baea-a28433ff1b6c', 'b5878a99-2ce4-422d-a45f-7a36949540c7', 'b79e72f5-026d-4b33-a715-4ba8b8d9681e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:36 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:41:36 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:36 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.883s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:41:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Deleted volume successfully. Jul 05 02:41:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fe0d1806-e3bf-405b-bfac-416e974fe35f tempest-ServersNegativeTestJSON-1523456071 None] Lock "cinder-aca557b3-9829-47a7-8922-45d0a0247d66-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:37 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.940s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:37 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:41:37 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-78daaaf2-1020-40e1-ae7f-e72035d12bc2 tempest-GroupSnapshotsTest-2146552497 None] Delete group completed successfully. Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Flow 'volume_create_manager' (6e98f5ae-9422-4234-bec1-28941a008b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef1ea7c-db2a-4d81-9d47-fa65b9d4dad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef1ea7c-db2a-4d81-9d47-fa65b9d4dad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-401141495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633b1b53-16e8-48be-9411-5720f10fe340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0439ed04e2784376b53d4c9fd1c3422b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:43Z,use_quota=True,user_id='baa51c245acf4044a238a4b4d35aefc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2912ef74-309d-455a-85f9-b51f851ec8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2912ef74-309d-455a-85f9-b51f851ec8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1467afcc-748a-4f9a-bc23-306aa608cda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1467afcc-748a-4f9a-bc23-306aa608cda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '633b1b53-16e8-48be-9411-5720f10fe340', 'volume_name': 'volume-633b1b53-16e8-48be-9411-5720f10fe340', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19014a6c-cf96-47e8-aeca-997699a3ded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19014a6c-cf96-47e8-aeca-997699a3ded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e411d36a-9656-4a4f-b563-f090a1ef42b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:43 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Volume 633b1b53-16e8-48be-9411-5720f10fe340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-633b1b53-16e8-48be-9411-5720f10fe340', 'volume_size': 1} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-401141495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633b1b53-16e8-48be-9411-5720f10fe340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0439ed04e2784376b53d4c9fd1c3422b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:43Z,use_quota=True,user_id='baa51c245acf4044a238a4b4d35aefc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Creating volume 633b1b53-16e8-48be-9411-5720f10fe340 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:41:43 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:41:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:43 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340 1073741824 Jul 05 02:41:43 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-768378cd-63d4-4e21-b64b-32e437c34cdc tempest-GroupsTest-1561059117 None] Group tempest-Group1-1476905827: creating Jul 05 02:41:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-768378cd-63d4-4e21-b64b-32e437c34cdc tempest-GroupsTest-1561059117 None] Group tempest-Group1-1476905827: created successfully Jul 05 02:41:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-768378cd-63d4-4e21-b64b-32e437c34cdc tempest-GroupsTest-1561059117 None] Create group completed successfully. Jul 05 02:41:44 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340 1073741824" returned: 0 in 0.928s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:44 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340 Jul 05 02:41:44 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ceee8d97-e437-4996-b992-98718edfa001 tempest-GroupsTest-1561059117 None] Group tempest-Group2-1546874069: creating Jul 05 02:41:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ceee8d97-e437-4996-b992-98718edfa001 tempest-GroupsTest-1561059117 None] Group tempest-Group2-1546874069: created successfully Jul 05 02:41:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ceee8d97-e437-4996-b992-98718edfa001 tempest-GroupsTest-1561059117 None] Create group completed successfully. Jul 05 02:41:45 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340" returned: 0 in 0.714s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:41:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e411d36a-9656-4a4f-b563-f090a1ef42b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-633b1b53-16e8-48be-9411-5720f10fe340', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7acc43-caa9-42ca-b9b8-120652547848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:45 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Volume volume-633b1b53-16e8-48be-9411-5720f10fe340 (633b1b53-16e8-48be-9411-5720f10fe340): created successfully Jul 05 02:41:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7acc43-caa9-42ca-b9b8-120652547848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Flow 'volume_create_manager' (6e98f5ae-9422-4234-bec1-28941a008b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-cd4873bb-ebaf-44e2-851b-8c70821c92d9 tempest-VolumesNegativeTest-2084290591 None] Created volume successfully. Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Flow 'volume_create_manager' (9edbd6b0-f777-4ba3-8171-8dc125e5d33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496864d6-7c39-491d-a1d1-e2a5bd299901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496864d6-7c39-491d-a1d1-e2a5bd299901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1884074436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1881d211-0d37-460b-ad50-4791407a55e8,host='devstack@QuobyteHD#QuobyteHD',id=53464db7-0004-4d71-84e3-3ab590624930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f100ddefa8a34c86a244bde0cf635b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:47Z,use_quota=True,user_id='825736a8c05a4ed08c71a3143476db66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fe9ca8f-9351-48e7-a6f9-5d6418ad53aa),volume_type_id=7fe9ca8f-9351-48e7-a6f9-5d6418ad53aa)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee09967-309c-4a2e-b70d-f993e3bf6e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee09967-309c-4a2e-b70d-f993e3bf6e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8ed436-c648-4c90-b23d-d489664e2ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8ed436-c648-4c90-b23d-d489664e2ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53464db7-0004-4d71-84e3-3ab590624930', 'volume_name': 'volume-53464db7-0004-4d71-84e3-3ab590624930', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d51384a-4df8-472a-b80a-5c3dbc71d0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d51384a-4df8-472a-b80a-5c3dbc71d0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450e8f95-7620-486a-b00e-452372d4056d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:46 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Volume 53464db7-0004-4d71-84e3-3ab590624930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53464db7-0004-4d71-84e3-3ab590624930', 'volume_size': 1} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1881d211-0d37-460b-ad50-4791407a55e8,created_at=2026-07-05T00:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1884074436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1881d211-0d37-460b-ad50-4791407a55e8,host='devstack@QuobyteHD#QuobyteHD',id=53464db7-0004-4d71-84e3-3ab590624930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f100ddefa8a34c86a244bde0cf635b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:41:47Z,use_quota=True,user_id='825736a8c05a4ed08c71a3143476db66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fe9ca8f-9351-48e7-a6f9-5d6418ad53aa),volume_type_id=7fe9ca8f-9351-48e7-a6f9-5d6418ad53aa)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Creating volume 53464db7-0004-4d71-84e3-3ab590624930 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:41:46 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:41:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:46 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930 1073741824 Jul 05 02:41:46 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:48 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930 1073741824" returned: 0 in 1.486s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:48 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930 Jul 05 02:41:48 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:49 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930" returned: 0 in 1.041s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] <== create_volume: return (2591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:41:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.596s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450e8f95-7620-486a-b00e-452372d4056d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53464db7-0004-4d71-84e3-3ab590624930', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e3d299-283c-412f-b322-8db7e3175295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:49 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Volume volume-53464db7-0004-4d71-84e3-3ab590624930 (53464db7-0004-4d71-84e3-3ab590624930): created successfully Jul 05 02:41:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e3d299-283c-412f-b322-8db7e3175295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Flow 'volume_create_manager' (9edbd6b0-f777-4ba3-8171-8dc125e5d33b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:49 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ee36aae9-91f5-4782-8e87-e02650e9195c tempest-GroupsTest-1561059117 None] Created volume successfully. Jul 05 02:41:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Acquiring lock "cinder-quobyte-53464db7-0004-4d71-84e3-3ab590624930" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:41:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Lock "cinder-quobyte-53464db7-0004-4d71-84e3-3ab590624930" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:41:51 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4349f93-9cea-4ea7-8cb5-8f57e83a66f7]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:41:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:51 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930 Jul 05 02:41:51 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:53 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930" returned: 0 in 1.579s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:53 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930 Jul 05 02:41:53 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-53464db7-0004-4d71-84e3-3ab590624930" returned: 0 in 0.972s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:54 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Lock "cinder-quobyte-53464db7-0004-4d71-84e3-3ab590624930" released by "delete_volume" :: held 2.670s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:41:54 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Created reservations ['b87eff18-43f4-4ea1-ba33-97fe8383620f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:54 devstack cinder-volume[86671]: WARNING cinder.quota [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-569744765 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-569744765, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:41:54 devstack cinder-volume[86671]: WARNING cinder.quota [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-569744765 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-569744765, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:41:54 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Created reservations ['6f1ed843-db4e-4ff8-b982-b0dfd9c2b644', 'f324a9dc-8345-4419-8227-ee87660df55d', '872a4287-7a98-4fa5-b3ea-adb9b5520114', '9e1e2caf-d386-4947-80e5-d61c465569ee'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:54 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:41:54 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:55 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-1b71a7a2-d44d-4dd0-a974-26e0a4d55bf7 tempest-GroupsTest-1561059117 None] Created reservations ['97ad703d-de2b-409a-864f-0464e9c5a1c5'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:41:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1b71a7a2-d44d-4dd0-a974-26e0a4d55bf7 tempest-GroupsTest-1561059117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1b71a7a2-d44d-4dd0-a974-26e0a4d55bf7 tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1b71a7a2-d44d-4dd0-a974-26e0a4d55bf7 tempest-GroupsTest-1561059117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1b71a7a2-d44d-4dd0-a974-26e0a4d55bf7 tempest-GroupsTest-1561059117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1b71a7a2-d44d-4dd0-a974-26e0a4d55bf7 tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1b71a7a2-d44d-4dd0-a974-26e0a4d55bf7 tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:55 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:41:55 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:41:55 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.532s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:55 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:41:55 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-75a1bf08-05f4-450c-8747-3ce149aa570c tempest-GroupsTest-1561059117 None] Delete group completed successfully. Jul 05 02:41:56 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Jul 05 02:41:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1b71a7a2-d44d-4dd0-a974-26e0a4d55bf7 tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.144s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:41:56 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-1b71a7a2-d44d-4dd0-a974-26e0a4d55bf7 tempest-GroupsTest-1561059117 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:41:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1b71a7a2-d44d-4dd0-a974-26e0a4d55bf7 tempest-GroupsTest-1561059117 None] Delete group completed successfully. Jul 05 02:41:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-88db489a-0d70-4ffc-8b9f-d698802d476e tempest-GroupsTest-1561059117 None] Group tempest-GroupsTest-Group-2109697925: creating Jul 05 02:41:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-88db489a-0d70-4ffc-8b9f-d698802d476e tempest-GroupsTest-1561059117 None] Group tempest-GroupsTest-Group-2109697925: created successfully Jul 05 02:41:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-88db489a-0d70-4ffc-8b9f-d698802d476e tempest-GroupsTest-1561059117 None] Create group completed successfully. Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Flow 'volume_create_manager' (6da14b22-5254-434f-a50c-486157109768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa88fa8b-56fb-4a0e-8549-03c165274bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa88fa8b-56fb-4a0e-8549-03c165274bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1845012470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ce5c68c-ff38-4291-a4ec-c14320bcc44a,host='devstack@QuobyteHD#QuobyteHD',id=caa18b63-d890-4695-80ab-f362203135bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f100ddefa8a34c86a244bde0cf635b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:42:00Z,use_quota=True,user_id='825736a8c05a4ed08c71a3143476db66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f020be-c6f6-4798-a841-df5548792fdc),volume_type_id=42f020be-c6f6-4798-a841-df5548792fdc)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc45b598-211b-4a10-8c2e-9de030d5cff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc45b598-211b-4a10-8c2e-9de030d5cff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab02a4d-e78c-41b1-8690-f4dbda852280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab02a4d-e78c-41b1-8690-f4dbda852280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa18b63-d890-4695-80ab-f362203135bd', 'volume_name': 'volume-caa18b63-d890-4695-80ab-f362203135bd', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716f4fbd-ad74-4460-bde3-3f77581a9a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716f4fbd-ad74-4460-bde3-3f77581a9a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c50d8c-2b32-456c-b2b4-9cbdda5430c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:41:59 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Volume caa18b63-d890-4695-80ab-f362203135bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa18b63-d890-4695-80ab-f362203135bd', 'volume_size': 1} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ce5c68c-ff38-4291-a4ec-c14320bcc44a,created_at=2026-07-05T00:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1845012470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ce5c68c-ff38-4291-a4ec-c14320bcc44a,host='devstack@QuobyteHD#QuobyteHD',id=caa18b63-d890-4695-80ab-f362203135bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f100ddefa8a34c86a244bde0cf635b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:42:00Z,use_quota=True,user_id='825736a8c05a4ed08c71a3143476db66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f020be-c6f6-4798-a841-df5548792fdc),volume_type_id=42f020be-c6f6-4798-a841-df5548792fdc)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Creating volume caa18b63-d890-4695-80ab-f362203135bd {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:41:59 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:41:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:41:59 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd 1073741824 Jul 05 02:41:59 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:01 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd 1073741824" returned: 0 in 1.277s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:01 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd Jul 05 02:42:01 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:02 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd" returned: 0 in 1.384s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] <== create_volume: return (2732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:42:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.736s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c50d8c-2b32-456c-b2b4-9cbdda5430c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa18b63-d890-4695-80ab-f362203135bd', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c34bfc5-e779-4b37-8f52-59e8637d5600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:02 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Volume volume-caa18b63-d890-4695-80ab-f362203135bd (caa18b63-d890-4695-80ab-f362203135bd): created successfully Jul 05 02:42:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c34bfc5-e779-4b37-8f52-59e8637d5600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Flow 'volume_create_manager' (6da14b22-5254-434f-a50c-486157109768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:42:02 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-369d5d71-95d7-4541-8df0-3193bc8118da tempest-GroupsTest-1561059117 None] Created volume successfully. Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Flow 'volume_create_manager' (3e70934e-b4ce-4117-9122-30eb8cb2bb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84817c5f-c65e-40ac-a04b-66410627af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84817c5f-c65e-40ac-a04b-66410627af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412203898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ce5c68c-ff38-4291-a4ec-c14320bcc44a,host='devstack@QuobyteHD#QuobyteHD',id=75c738d6-9ac8-4930-8475-b90b7c498e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f100ddefa8a34c86a244bde0cf635b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:42:04Z,use_quota=True,user_id='825736a8c05a4ed08c71a3143476db66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f020be-c6f6-4798-a841-df5548792fdc),volume_type_id=42f020be-c6f6-4798-a841-df5548792fdc)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b72351-738e-4c77-ae05-b96b6513f8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b72351-738e-4c77-ae05-b96b6513f8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04238f0-2d3c-409d-92d7-3d65850b5f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04238f0-2d3c-409d-92d7-3d65850b5f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c738d6-9ac8-4930-8475-b90b7c498e7c', 'volume_name': 'volume-75c738d6-9ac8-4930-8475-b90b7c498e7c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4190ae28-6cdc-4b94-83c7-5937a377de45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4190ae28-6cdc-4b94-83c7-5937a377de45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f678e847-8e5f-42f3-8c1c-49526458f647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:04 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Volume 75c738d6-9ac8-4930-8475-b90b7c498e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c738d6-9ac8-4930-8475-b90b7c498e7c', 'volume_size': 1} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ce5c68c-ff38-4291-a4ec-c14320bcc44a,created_at=2026-07-05T00:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412203898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ce5c68c-ff38-4291-a4ec-c14320bcc44a,host='devstack@QuobyteHD#QuobyteHD',id=75c738d6-9ac8-4930-8475-b90b7c498e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f100ddefa8a34c86a244bde0cf635b6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:42:04Z,use_quota=True,user_id='825736a8c05a4ed08c71a3143476db66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f020be-c6f6-4798-a841-df5548792fdc),volume_type_id=42f020be-c6f6-4798-a841-df5548792fdc)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Creating volume 75c738d6-9ac8-4930-8475-b90b7c498e7c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:42:04 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:42:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:04 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c 1073741824 Jul 05 02:42:04 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:42:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:42:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:42:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:05 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:42:05 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:06 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c 1073741824" returned: 0 in 1.512s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:06 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c Jul 05 02:42:06 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:06 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.078s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:42:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:42:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 8 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:42:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:42:07 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c" returned: 0 in 0.870s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] <== create_volume: return (2455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:42:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.459s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f678e847-8e5f-42f3-8c1c-49526458f647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c738d6-9ac8-4930-8475-b90b7c498e7c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff9fa18-e735-4fd0-82aa-a3605d6747be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:07 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Volume volume-75c738d6-9ac8-4930-8475-b90b7c498e7c (75c738d6-9ac8-4930-8475-b90b7c498e7c): created successfully Jul 05 02:42:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff9fa18-e735-4fd0-82aa-a3605d6747be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Flow 'volume_create_manager' (3e70934e-b4ce-4117-9122-30eb8cb2bb95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:42:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1e29a06f-edcc-425c-aec6-c9ce19f554c7 tempest-GroupsTest-1561059117 None] Created volume successfully. Jul 05 02:42:08 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-88a77522-2497-44e0-96bd-af2d247372a5 tempest-GroupsTest-1561059117 None] Update group completed successfully. Jul 05 02:42:09 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0a24d15b-c8ef-47c0-9d8e-f9e8a85a7395 tempest-GroupsTest-1561059117 None] Update group completed successfully. Jul 05 02:42:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Acquiring lock "cinder-quobyte-75c738d6-9ac8-4930-8475-b90b7c498e7c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:42:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Lock "cinder-quobyte-75c738d6-9ac8-4930-8475-b90b7c498e7c" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:42:11 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3afbce-1863-492a-8c3f-0a38248b781f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:42:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:11 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c Jul 05 02:42:11 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:12 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c" returned: 0 in 0.767s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:12 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c Jul 05 02:42:12 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:13 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-75c738d6-9ac8-4930-8475-b90b7c498e7c" returned: 0 in 0.656s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Lock "cinder-quobyte-75c738d6-9ac8-4930-8475-b90b7c498e7c" released by "delete_volume" :: held 1.479s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:42:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Acquiring lock "cinder-quobyte-caa18b63-d890-4695-80ab-f362203135bd" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:42:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Lock "cinder-quobyte-caa18b63-d890-4695-80ab-f362203135bd" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:42:13 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fdc492-fc05-4325-bacb-f917fa4e2cec]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:42:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:13 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd Jul 05 02:42:13 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:14 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd" returned: 0 in 0.815s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:14 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd Jul 05 02:42:14 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:14 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-caa18b63-d890-4695-80ab-f362203135bd" returned: 0 in 0.674s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Lock "cinder-quobyte-caa18b63-d890-4695-80ab-f362203135bd" released by "delete_volume" :: held 1.543s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:42:14 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Created reservations ['2efa90dd-e285-45a3-855b-7d7d833b0696'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:42:14 devstack cinder-volume[86671]: WARNING cinder.quota [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1557359558 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1557359558, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:42:14 devstack cinder-volume[86671]: WARNING cinder.quota [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1557359558 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1557359558, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:42:14 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Created reservations ['a6026963-9283-41cc-8589-1ab865bead99', '1d96abb9-54b1-4416-b7b3-f74d79b27557', '93ade14a-8dd9-4a7c-89ca-33b63d681ae8', '299c6ebc-0e6c-428a-a777-e1e5f307f586'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:42:14 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Created reservations ['d5b0c76e-d945-48fe-80fa-6e5780477647', 'e6c22dd6-597e-478d-8c3f-1a867d9a09f7', '3c31216f-2dca-4601-a6fb-977eb6ca4908', '14c25af8-3a6f-4c23-bec2-32460b382e6b'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:42:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:42:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:42:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:15 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:42:15 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:15 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.744s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:15 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:42:15 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b7c3b4ad-be42-4654-9b3c-2f56298e3622 tempest-GroupsTest-1561059117 None] Delete group completed successfully. Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Flow 'volume_create_manager' (8bc8fd86-db29-42b0-b7ea-e1b6286544be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd619f3-ad82-4e7d-989c-e032e8f9d778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd619f3-ad82-4e7d-989c-e032e8f9d778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-726996425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df94c7af-d970-4cf3-8482-130a5dc467e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850e9a6f02cf4d3cb381972d18b854f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:42:17Z,use_quota=True,user_id='e5a032579f58459cbde358364ddae477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6fd99e-2bcc-4b16-921d-084b7dfd00d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6fd99e-2bcc-4b16-921d-084b7dfd00d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686f9cec-8db9-40ac-ab3e-6f654229db99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686f9cec-8db9-40ac-ab3e-6f654229db99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df94c7af-d970-4cf3-8482-130a5dc467e6', 'volume_name': 'volume-df94c7af-d970-4cf3-8482-130a5dc467e6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae03a68-e17c-4404-961d-84024daf1502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae03a68-e17c-4404-961d-84024daf1502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d505ce8-0687-41b5-a8ce-24c65d317014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:17 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Volume df94c7af-d970-4cf3-8482-130a5dc467e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df94c7af-d970-4cf3-8482-130a5dc467e6', 'volume_size': 1} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-726996425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df94c7af-d970-4cf3-8482-130a5dc467e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850e9a6f02cf4d3cb381972d18b854f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:42:17Z,use_quota=True,user_id='e5a032579f58459cbde358364ddae477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Creating volume df94c7af-d970-4cf3-8482-130a5dc467e6 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:42:17 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:42:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:17 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 1073741824 Jul 05 02:42:17 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:18 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 1073741824" returned: 0 in 1.184s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:18 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 Jul 05 02:42:18 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:19 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6" returned: 0 in 0.900s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] <== create_volume: return (2194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:42:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d505ce8-0687-41b5-a8ce-24c65d317014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df94c7af-d970-4cf3-8482-130a5dc467e6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d47b60e-3f7f-4491-9148-eacd6cab99bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:19 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Volume volume-df94c7af-d970-4cf3-8482-130a5dc467e6 (df94c7af-d970-4cf3-8482-130a5dc467e6): created successfully Jul 05 02:42:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d47b60e-3f7f-4491-9148-eacd6cab99bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Flow 'volume_create_manager' (8bc8fd86-db29-42b0-b7ea-e1b6286544be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:42:19 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c89bcf8c-5c31-44a9-b0c9-2d50ef829825 tempest-AttachVolumeNegativeTest-149954460 None] Created volume successfully. Jul 05 02:42:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-394a1231-78ac-4c0d-b7e6-5779976cd02d tempest-GroupsV320Test-1947664943 None] Group tempest-GroupsV320Test-Group-31057405: creating Jul 05 02:42:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-394a1231-78ac-4c0d-b7e6-5779976cd02d tempest-GroupsV320Test-1947664943 None] Group tempest-GroupsV320Test-Group-31057405: created successfully Jul 05 02:42:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-394a1231-78ac-4c0d-b7e6-5779976cd02d tempest-GroupsV320Test-1947664943 None] Create group completed successfully. Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-0cf1d1c1-9d52-4f84-81d7-902511d1fe36 tempest-GroupsV320Test-1947664943 None] Created reservations ['712493ae-4293-484f-8963-ae0b4e1092a8'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Acquiring lock "cinder-633b1b53-16e8-48be-9411-5720f10fe340-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Lock "cinder-633b1b53-16e8-48be-9411-5720f10fe340-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0cf1d1c1-9d52-4f84-81d7-902511d1fe36 tempest-GroupsV320Test-1947664943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0cf1d1c1-9d52-4f84-81d7-902511d1fe36 tempest-GroupsV320Test-1947664943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0cf1d1c1-9d52-4f84-81d7-902511d1fe36 tempest-GroupsV320Test-1947664943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0cf1d1c1-9d52-4f84-81d7-902511d1fe36 tempest-GroupsV320Test-1947664943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0cf1d1c1-9d52-4f84-81d7-902511d1fe36 tempest-GroupsV320Test-1947664943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0cf1d1c1-9d52-4f84-81d7-902511d1fe36 tempest-GroupsV320Test-1947664943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Acquiring lock "cinder-quobyte-633b1b53-16e8-48be-9411-5720f10fe340" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:42:23 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:42:23 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Lock "cinder-quobyte-633b1b53-16e8-48be-9411-5720f10fe340" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f721c454-0d8e-4e06-ab28-bcdace2ecbf4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:42:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:23 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340 Jul 05 02:42:23 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:24 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0cf1d1c1-9d52-4f84-81d7-902511d1fe36 tempest-GroupsV320Test-1947664943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.923s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:24 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-0cf1d1c1-9d52-4f84-81d7-902511d1fe36 tempest-GroupsV320Test-1947664943 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:42:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0cf1d1c1-9d52-4f84-81d7-902511d1fe36 tempest-GroupsV320Test-1947664943 None] Delete group completed successfully. Jul 05 02:42:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c3892f0a-00e1-4285-8efb-f93d22496f66 req-b8f1362d-0d05-460d-891c-ca7770316f59 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c3892f0a-00e1-4285-8efb-f93d22496f66 req-b8f1362d-0d05-460d-891c-ca7770316f59 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:24 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadc59ec-a5aa-4881-918d-5054dafbe5ba]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:42:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c3892f0a-00e1-4285-8efb-f93d22496f66 req-b8f1362d-0d05-460d-891c-ca7770316f59 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:24 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340" returned: 0 in 1.132s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:24 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340 Jul 05 02:42:24 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:24 devstack sudo[92952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 Jul 05 02:42:24 devstack sudo[92952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:25 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-633b1b53-16e8-48be-9411-5720f10fe340" returned: 0 in 0.875s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Lock "cinder-quobyte-633b1b53-16e8-48be-9411-5720f10fe340" released by "delete_volume" :: held 2.087s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Created reservations ['c103bc1d-7e7c-4a34-8a43-60c010113638', '4a4408fd-b047-4d4e-bd7a-7c5273f186fc', 'cf5c900f-df41-4931-852a-ffdee8f3ac93', '5b9fac28-01ef-4d8a-8c0c-fee65c32a107'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:42:25 devstack sudo[92952]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c3892f0a-00e1-4285-8efb-f93d22496f66 req-b8f1362d-0d05-460d-891c-ca7770316f59 tempest-AttachVolumeNegativeTest-149954460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6" returned: 0 in 1.041s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c3892f0a-00e1-4285-8efb-f93d22496f66 req-b8f1362d-0d05-460d-891c-ca7770316f59 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.074s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-c3892f0a-00e1-4285-8efb-f93d22496f66 req-b8f1362d-0d05-460d-891c-ca7770316f59 tempest-AttachVolumeNegativeTest-149954460 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-df94c7af-d970-4cf3-8482-130a5dc467e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '555eaee1-36bf-4557-9a4a-40a426189429', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:25 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:42:25 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:25 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-c3892f0a-00e1-4285-8efb-f93d22496f66 req-b8f1362d-0d05-460d-891c-ca7770316f59 tempest-AttachVolumeNegativeTest-149954460 None] attachment_update completed successfully. Jul 05 02:42:26 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.943s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:26 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:42:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Deleted volume successfully. Jul 05 02:42:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-607b17f3-f236-417e-b2fc-60e9609017cc tempest-VolumesNegativeTest-2084290591 None] Lock "cinder-633b1b53-16e8-48be-9411-5720f10fe340-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:42:32 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=96,cinder:SELECT=86,cinder:INSERT=24,cinder:DELETE=6 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:42:32 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:DELETE=5,cinder:UPDATE=118,cinder:INSERT=23,cinder:SELECT=102 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:42:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-4f299110-3824-4874-b640-76c6ce6e0eed req-8063221f-a52e-4a9b-899c-5581552c4f9b tempest-AttachVolumeNegativeTest-149954460 None] Terminate volume connection completed successfully. Jul 05 02:42:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-4f299110-3824-4874-b640-76c6ce6e0eed req-8063221f-a52e-4a9b-899c-5581552c4f9b tempest-AttachVolumeNegativeTest-149954460 None] Deleting attachment 555eaee1-36bf-4557-9a4a-40a426189429. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Flow 'volume_create_manager' (a3c91a1c-df1d-4f28-a38d-fbf1ea363dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db71b15-bb05-4407-83ce-5bee8ca5ce77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db71b15-bb05-4407-83ce-5bee8ca5ce77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-730675005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9b7c97-e6e5-492a-b4fb-8c26dead457e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a0877a49814ac7a36de7852ef0cb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:42:52Z,use_quota=True,user_id='54263e315d36407197a20e0ee6d70293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc23753-9ff7-4b87-adb5-ee85ef81d713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc23753-9ff7-4b87-adb5-ee85ef81d713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c07a4b-0c52-4a58-a7e2-4f6251c85f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c07a4b-0c52-4a58-a7e2-4f6251c85f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9b7c97-e6e5-492a-b4fb-8c26dead457e', 'volume_name': 'volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0299ec6f-3602-4b10-a41e-f9f42e539929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0299ec6f-3602-4b10-a41e-f9f42e539929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1d09cc-f010-46c3-a4bf-37387b592a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:52 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Volume 6a9b7c97-e6e5-492a-b4fb-8c26dead457e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e', 'volume_size': 1} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-730675005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9b7c97-e6e5-492a-b4fb-8c26dead457e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a0877a49814ac7a36de7852ef0cb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:42:52Z,use_quota=True,user_id='54263e315d36407197a20e0ee6d70293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Creating volume 6a9b7c97-e6e5-492a-b4fb-8c26dead457e {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:42:52 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:42:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:52 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e 1073741824 Jul 05 02:42:52 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:53 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e 1073741824" returned: 0 in 1.015s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:53 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e Jul 05 02:42:53 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:54 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e" returned: 0 in 0.834s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1d09cc-f010-46c3-a4bf-37387b592a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e608d4d-a46d-4314-abf9-561bb43b8a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:54 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Volume volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e (6a9b7c97-e6e5-492a-b4fb-8c26dead457e): created successfully Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e608d4d-a46d-4314-abf9-561bb43b8a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Flow 'volume_create_manager' (a3c91a1c-df1d-4f28-a38d-fbf1ea363dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:42:54 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b1fa2655-70b7-4604-8656-5a664218add7 tempest-AttachVolumeTestJSON-563296492 None] Created volume successfully. Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Flow 'volume_create_manager' (51e41382-62bd-4ab4-a758-418772ed4f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03975c81-5ae2-4086-8caa-a41f2e8b96d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03975c81-5ae2-4086-8caa-a41f2e8b96d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-401128468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333714d0-f1ee-41e7-be9a-0a4fb6caec8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d0015bc0004496bb6967c67c0c36c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:42:55Z,use_quota=True,user_id='bb59aed49d074e9488becb26d60950cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc435dc1-cf76-4028-b06e-b8ee2ebf9555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc435dc1-cf76-4028-b06e-b8ee2ebf9555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33b403e-8079-492e-895c-6c6200d6877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33b403e-8079-492e-895c-6c6200d6877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333714d0-f1ee-41e7-be9a-0a4fb6caec8d', 'volume_name': 'volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f535d5-f08e-40b3-b467-3175048ad0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f535d5-f08e-40b3-b467-3175048ad0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f963e1e2-c27b-4d0b-b8d9-56f6ec37e7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:54 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Volume 333714d0-f1ee-41e7-be9a-0a4fb6caec8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d', 'volume_size': 1} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-401128468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333714d0-f1ee-41e7-be9a-0a4fb6caec8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d0015bc0004496bb6967c67c0c36c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:42:55Z,use_quota=True,user_id='bb59aed49d074e9488becb26d60950cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Creating volume 333714d0-f1ee-41e7-be9a-0a4fb6caec8d {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:42:54 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:42:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:54 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d 1073741824 Jul 05 02:42:54 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:55 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d 1073741824" returned: 0 in 1.054s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:55 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d Jul 05 02:42:55 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d" returned: 0 in 0.895s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:42:56 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f963e1e2-c27b-4d0b-b8d9-56f6ec37e7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1039473-1729-418f-9e55-a64bd7654e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:42:56 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Volume volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d (333714d0-f1ee-41e7-be9a-0a4fb6caec8d): created successfully Jul 05 02:42:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1039473-1729-418f-9e55-a64bd7654e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:42:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Flow 'volume_create_manager' (51e41382-62bd-4ab4-a758-418772ed4f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:42:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-946db895-2fb8-491f-a441-fb9ca20afa4e tempest-VolumeQuotasNegativeTestJSON-329148655 None] Created volume successfully. Jul 05 02:42:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-4562750d-0550-4bd3-8a9c-29b3f0379189 req-ddfe6a71-f82a-4504-80e9-e2a74164d800 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:42:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-4562750d-0550-4bd3-8a9c-29b3f0379189 req-ddfe6a71-f82a-4504-80e9-e2a74164d800 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:42:58 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c955fd-052c-44f1-b382-d2112846bd6f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:42:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4562750d-0550-4bd3-8a9c-29b3f0379189 req-ddfe6a71-f82a-4504-80e9-e2a74164d800 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:59 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e Jul 05 02:42:59 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Acquiring lock "cinder-333714d0-f1ee-41e7-be9a-0a4fb6caec8d-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:42:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Lock "cinder-333714d0-f1ee-41e7-be9a-0a4fb6caec8d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:42:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Acquiring lock "cinder-quobyte-333714d0-f1ee-41e7-be9a-0a4fb6caec8d" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:42:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Lock "cinder-quobyte-333714d0-f1ee-41e7-be9a-0a4fb6caec8d" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:42:59 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb47c0b-eca6-4e95-ad0a-0782d8765e76]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:42:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:42:59 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d Jul 05 02:42:59 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:42:59 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Jul 05 02:42:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4562750d-0550-4bd3-8a9c-29b3f0379189 req-ddfe6a71-f82a-4504-80e9-e2a74164d800 tempest-AttachVolumeTestJSON-563296492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e" returned: 0 in 0.945s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:42:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-4562750d-0550-4bd3-8a9c-29b3f0379189 req-ddfe6a71-f82a-4504-80e9-e2a74164d800 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:42:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-4562750d-0550-4bd3-8a9c-29b3f0379189 req-ddfe6a71-f82a-4504-80e9-e2a74164d800 tempest-AttachVolumeTestJSON-563296492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '389bb36c-d9e8-4636-93f3-c96f8a930e60', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:42:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-4562750d-0550-4bd3-8a9c-29b3f0379189 req-ddfe6a71-f82a-4504-80e9-e2a74164d800 tempest-AttachVolumeTestJSON-563296492 None] attachment_update completed successfully. Jul 05 02:43:00 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d" returned: 0 in 0.816s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:00 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d Jul 05 02:43:00 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:01 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-333714d0-f1ee-41e7-be9a-0a4fb6caec8d" returned: 0 in 0.787s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Lock "cinder-quobyte-333714d0-f1ee-41e7-be9a-0a4fb6caec8d" released by "delete_volume" :: held 1.660s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:43:01 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Created reservations ['c219a154-6e9f-44dc-b552-651502a42ee7', 'd2853f84-7bce-4a66-b303-3f6989f0a908', '8bb28df1-21b0-4c23-8588-5d61cefcb98a', 'a5374c32-997d-4ce1-a013-6a42a3c7b17c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:43:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:01 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:43:01 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:02 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.004s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:02 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:43:02 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Deleted volume successfully. Jul 05 02:43:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2c8bc9f5-b227-4875-9981-4f1214eacaf0 tempest-VolumeQuotasNegativeTestJSON-329148655 None] Lock "cinder-333714d0-f1ee-41e7-be9a-0a4fb6caec8d-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:43:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:43:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:05 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:43:05 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:06 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.975s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:43:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:43:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 8 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:43:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=18,cinder:UPDATE=17,cinder:INSERT=3 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Flow 'volume_create_manager' (c073a2d1-257b-4eba-9ae2-7ccc62447aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2fd15c-9d05-4202-b1f7-75d66bc03004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2fd15c-9d05-4202-b1f7-75d66bc03004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1055869208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fa74a3885a4674afbc5fd005fc7ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:11Z,use_quota=True,user_id='2d826d335f7d451d9b762f110adf6b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c0263c1-d071-4e13-b010-0fdf504b6fe9),volume_type_id=9c0263c1-d071-4e13-b010-0fdf504b6fe9)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaf5837-6c62-4bdd-8a6b-c776f57aa6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaf5837-6c62-4bdd-8a6b-c776f57aa6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59416cb-31ed-4333-bd6d-d17694f5598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59416cb-31ed-4333-bd6d-d17694f5598e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1', 'volume_name': 'volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642dbe65-4e80-402d-aa0f-0fd8d420e257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642dbe65-4e80-402d-aa0f-0fd8d420e257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d3a3cf-93ff-4e8e-92c8-1f360c795ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Volume ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1', 'volume_size': 1} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1055869208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fa74a3885a4674afbc5fd005fc7ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:11Z,use_quota=True,user_id='2d826d335f7d451d9b762f110adf6b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c0263c1-d071-4e13-b010-0fdf504b6fe9),volume_type_id=9c0263c1-d071-4e13-b010-0fdf504b6fe9)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Creating volume ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:43:11 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:43:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:11 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 1073741824 Jul 05 02:43:11 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:12 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 1073741824" returned: 0 in 1.002s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:12 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 Jul 05 02:43:12 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:13 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1" returned: 0 in 0.762s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:43:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2d3a3cf-93ff-4e8e-92c8-1f360c795ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f567b245-0d7d-4c98-be62-c4e17a694b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:13 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Volume volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 (ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1): created successfully Jul 05 02:43:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f567b245-0d7d-4c98-be62-c4e17a694b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Flow 'volume_create_manager' (c073a2d1-257b-4eba-9ae2-7ccc62447aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b4f7e325-acd6-415b-b974-b84081f35c76 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Created volume successfully. Jul 05 02:43:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-25d42d2c-fba3-444f-9083-5ee269b92518 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-25d42d2c-fba3-444f-9083-5ee269b92518 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-25d42d2c-fba3-444f-9083-5ee269b92518 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-25d42d2c-fba3-444f-9083-5ee269b92518 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-25d42d2c-fba3-444f-9083-5ee269b92518 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-25d42d2c-fba3-444f-9083-5ee269b92518 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:15 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:43:15 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:16 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-25d42d2c-fba3-444f-9083-5ee269b92518 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.863s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:16 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-25d42d2c-fba3-444f-9083-5ee269b92518 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:43:16 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-25d42d2c-fba3-444f-9083-5ee269b92518 tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Retype volume completed successfully. Jul 05 02:43:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Acquiring lock "cinder-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:43:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "cinder-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:43:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Acquiring lock "cinder-quobyte-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:43:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "cinder-quobyte-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1" acquired by "delete_volume" :: waited 0.039s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:43:17 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c088fc1c-9061-4031-8cea-a617b51c0d25]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:43:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:17 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 Jul 05 02:43:17 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:18 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1" returned: 0 in 1.141s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:18 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1 Jul 05 02:43:18 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:19 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1" returned: 0 in 0.887s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "cinder-quobyte-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1" released by "delete_volume" :: held 2.109s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:43:19 devstack cinder-volume[86671]: WARNING cinder.quota [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:43:19 devstack cinder-volume[86671]: WARNING cinder.quota [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:43:19 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Created reservations ['08ee371c-cfb8-490e-9588-5ab309fc9404', 'e39ca530-f951-4fbd-83cd-1087ce845a2d', '0f69be2c-b761-44f8-93d3-09a8b1ceb3cf', 'f142cf65-683b-48fa-a328-ef59fcd074bb'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:43:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:19 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:43:19 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:20 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.766s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:20 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:43:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Deleted volume successfully. Jul 05 02:43:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8494d88d-3a21-450c-926a-cc37251e879e tempest-VolumeRetypeWithoutMigrationTest-291421542 None] Lock "cinder-ef28b5eb-e3d0-4356-87b9-fcc22a9f93f1-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Flow 'volume_create_manager' (0d5a61bd-9a12-4ea9-9b4f-ec5f3356674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbf3816-e564-40cd-8659-494d7c7d0c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbf3816-e564-40cd-8659-494d7c7d0c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-497660822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc0852a-92b1-4abb-825b-3431df4eada6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f917ed0e6c044a5ba8833ef5e2d49016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:23Z,use_quota=True,user_id='bfe0e3cedbb640f29165efed135d17e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d37756b-36a7-4111-97e8-775c669890fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d37756b-36a7-4111-97e8-775c669890fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de88703-1a5b-4bd3-b660-6e7e257c6a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de88703-1a5b-4bd3-b660-6e7e257c6a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc0852a-92b1-4abb-825b-3431df4eada6', 'volume_name': 'volume-8cc0852a-92b1-4abb-825b-3431df4eada6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1287450a-294a-4749-b269-518820bbec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1287450a-294a-4749-b269-518820bbec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6878153b-1f60-4e40-83c4-010dd9b2f908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:23 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Volume 8cc0852a-92b1-4abb-825b-3431df4eada6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc0852a-92b1-4abb-825b-3431df4eada6', 'volume_size': 1} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-497660822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc0852a-92b1-4abb-825b-3431df4eada6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f917ed0e6c044a5ba8833ef5e2d49016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:23Z,use_quota=True,user_id='bfe0e3cedbb640f29165efed135d17e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Creating volume 8cc0852a-92b1-4abb-825b-3431df4eada6 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:43:23 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:43:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:23 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 1073741824 Jul 05 02:43:23 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:24 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 1073741824" returned: 0 in 1.585s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:24 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 Jul 05 02:43:24 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:26 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6" returned: 0 in 1.314s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] <== create_volume: return (2983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:43:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.986s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6878153b-1f60-4e40-83c4-010dd9b2f908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc0852a-92b1-4abb-825b-3431df4eada6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea14f786-1e25-4322-a8ba-ef93761365b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:26 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Volume volume-8cc0852a-92b1-4abb-825b-3431df4eada6 (8cc0852a-92b1-4abb-825b-3431df4eada6): created successfully Jul 05 02:43:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea14f786-1e25-4322-a8ba-ef93761365b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Flow 'volume_create_manager' (0d5a61bd-9a12-4ea9-9b4f-ec5f3356674f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-add8e38b-37b4-4357-b033-b1d209398c31 tempest-TestMinimumBasicScenario-373829211 None] Created volume successfully. Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Flow 'volume_create_manager' (6d456a1c-af2a-4c62-ba4f-fb4d6d4470c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b1e2bc-f85b-4cc2-9319-b710422062fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b1e2bc-f85b-4cc2-9319-b710422062fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1403885572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a16c94-316d-4441-b31f-b23da5a516e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0e970a164243f2ba9436389bc3d676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:29Z,use_quota=True,user_id='69f631393e35449fac6b0e5519781860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250fc255-7e50-41af-ae79-9b0a17a942d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250fc255-7e50-41af-ae79-9b0a17a942d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f04e312-f051-4b6d-aba0-d47b9835b07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f04e312-f051-4b6d-aba0-d47b9835b07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a16c94-316d-4441-b31f-b23da5a516e8', 'volume_name': 'volume-48a16c94-316d-4441-b31f-b23da5a516e8', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c657daf-553c-48c9-b023-22a216a6150a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c657daf-553c-48c9-b023-22a216a6150a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6fbac9-5bb7-4b68-a0b2-84e04ef1c4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:29 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Volume 48a16c94-316d-4441-b31f-b23da5a516e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a16c94-316d-4441-b31f-b23da5a516e8', 'volume_size': 1} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1403885572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a16c94-316d-4441-b31f-b23da5a516e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0e970a164243f2ba9436389bc3d676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:29Z,use_quota=True,user_id='69f631393e35449fac6b0e5519781860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Creating volume 48a16c94-316d-4441-b31f-b23da5a516e8 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:43:29 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:43:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:29 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8 1073741824 Jul 05 02:43:29 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-75b5400d-a14e-45a7-8ef9-c13c01cdb2b6 req-c4a7c505-586c-4c8d-9170-b32ea77e3147 tempest-TestMinimumBasicScenario-373829211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:30 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8 1073741824" returned: 0 in 0.966s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:30 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8 Jul 05 02:43:30 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:31 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8" returned: 0 in 0.698s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:43:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-75b5400d-a14e-45a7-8ef9-c13c01cdb2b6 req-c4a7c505-586c-4c8d-9170-b32ea77e3147 tempest-TestMinimumBasicScenario-373829211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.909s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6fbac9-5bb7-4b68-a0b2-84e04ef1c4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a16c94-316d-4441-b31f-b23da5a516e8', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708dc781-8de8-497a-88ff-7b05cf5bc693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d0c64f-9695-46ac-b378-80d60b6d601d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:43:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-75b5400d-a14e-45a7-8ef9-c13c01cdb2b6 req-c4a7c505-586c-4c8d-9170-b32ea77e3147 tempest-TestMinimumBasicScenario-373829211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:31 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Volume volume-48a16c94-316d-4441-b31f-b23da5a516e8 (48a16c94-316d-4441-b31f-b23da5a516e8): created successfully Jul 05 02:43:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708dc781-8de8-497a-88ff-7b05cf5bc693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Flow 'volume_create_manager' (6d456a1c-af2a-4c62-ba4f-fb4d6d4470c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-10066ee5-f659-4623-8361-21dd69543a55 tempest-VolumesServicesTestJSON-1183390275 None] Created volume successfully. Jul 05 02:43:31 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 Jul 05 02:43:31 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Flow 'volume_create_manager' (9a48d787-885e-41cc-be3d-74ecbde86233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75674448-a4c8-4724-83f2-a11af37ded4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75674448-a4c8-4724-83f2-a11af37ded4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-300308239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c38af5-0cc1-4c08-a00d-475bfe29cdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850e9a6f02cf4d3cb381972d18b854f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:32Z,use_quota=True,user_id='e5a032579f58459cbde358364ddae477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:32 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7888f944-1fd3-4480-862a-b9e989173bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7888f944-1fd3-4480-862a-b9e989173bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c13d7c-f159-4b84-8069-7bce810c7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c13d7c-f159-4b84-8069-7bce810c7be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c38af5-0cc1-4c08-a00d-475bfe29cdeb', 'volume_name': 'volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6989b9-c6c3-4694-bdf1-34b6d1e92bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6989b9-c6c3-4694-bdf1-34b6d1e92bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb623c6-d70a-4afa-9568-5076d57a3c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:32 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Volume a2c38af5-0cc1-4c08-a00d-475bfe29cdeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb', 'volume_size': 1} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Acquiring lock "cinder-48a16c94-316d-4441-b31f-b23da5a516e8-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-75b5400d-a14e-45a7-8ef9-c13c01cdb2b6 req-c4a7c505-586c-4c8d-9170-b32ea77e3147 tempest-TestMinimumBasicScenario-373829211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6" returned: 0 in 1.083s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-75b5400d-a14e-45a7-8ef9-c13c01cdb2b6 req-c4a7c505-586c-4c8d-9170-b32ea77e3147 tempest-TestMinimumBasicScenario-373829211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.128s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.023s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-300308239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c38af5-0cc1-4c08-a00d-475bfe29cdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='850e9a6f02cf4d3cb381972d18b854f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:32Z,use_quota=True,user_id='e5a032579f58459cbde358364ddae477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Creating volume a2c38af5-0cc1-4c08-a00d-475bfe29cdeb {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:43:32 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Lock "cinder-48a16c94-316d-4441-b31f-b23da5a516e8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:43:32 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb 1073741824 Jul 05 02:43:32 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-75b5400d-a14e-45a7-8ef9-c13c01cdb2b6 req-c4a7c505-586c-4c8d-9170-b32ea77e3147 tempest-TestMinimumBasicScenario-373829211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-8cc0852a-92b1-4abb-825b-3431df4eada6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95857b6e-b94a-4eca-b37f-b552087ff709', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Acquiring lock "cinder-quobyte-48a16c94-316d-4441-b31f-b23da5a516e8" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Lock "cinder-quobyte-48a16c94-316d-4441-b31f-b23da5a516e8" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86b6890-4f7f-4ae6-84cb-9449c773efa2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:43:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-75b5400d-a14e-45a7-8ef9-c13c01cdb2b6 req-c4a7c505-586c-4c8d-9170-b32ea77e3147 tempest-TestMinimumBasicScenario-373829211 None] attachment_update completed successfully. Jul 05 02:43:32 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8 Jul 05 02:43:32 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:33 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb 1073741824" returned: 0 in 0.909s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:33 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb Jul 05 02:43:33 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:33 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8" returned: 0 in 0.929s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:33 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8 Jul 05 02:43:33 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:33 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb" returned: 0 in 0.738s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb623c6-d70a-4afa-9568-5076d57a3c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f629ec5-162b-49b8-bdf7-42ae0264d494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:33 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Volume volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb (a2c38af5-0cc1-4c08-a00d-475bfe29cdeb): created successfully Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f629ec5-162b-49b8-bdf7-42ae0264d494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Flow 'volume_create_manager' (9a48d787-885e-41cc-be3d-74ecbde86233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1812a84e-e5aa-4bb3-9545-003a26999e32 tempest-AttachVolumeNegativeTest-149954460 None] Created volume successfully. Jul 05 02:43:33 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-48a16c94-316d-4441-b31f-b23da5a516e8" returned: 0 in 0.723s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Lock "cinder-quobyte-48a16c94-316d-4441-b31f-b23da5a516e8" released by "delete_volume" :: held 1.704s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:43:34 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Created reservations ['c2ce087c-3701-4318-9aac-c9a3566eb15e', 'f4159e37-c5f8-400f-84bc-69c11cd1d5f7', '89b30cf3-9db2-4731-9d3f-9d1284e9602f', 'cea7b286-e1e8-4a84-8055-17b3aa568df9'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:43:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:34 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:43:34 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:34 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.691s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:34 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:43:34 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Deleted volume successfully. Jul 05 02:43:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6604f595-e4a2-420a-a48e-10512698e2cf tempest-VolumesServicesTestJSON-1183390275 None] Lock "cinder-48a16c94-316d-4441-b31f-b23da5a516e8-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:43:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-516e76b1-a64f-470d-9ec8-eb71b288382e req-3cb3a52c-cbd7-477d-a155-429ae701efc3 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-516e76b1-a64f-470d-9ec8-eb71b288382e req-3cb3a52c-cbd7-477d-a155-429ae701efc3 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:37 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[689dbb9b-0411-483a-9af1-f2786016cc20]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:43:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-516e76b1-a64f-470d-9ec8-eb71b288382e req-3cb3a52c-cbd7-477d-a155-429ae701efc3 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:38 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb Jul 05 02:43:38 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:38 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-516e76b1-a64f-470d-9ec8-eb71b288382e req-3cb3a52c-cbd7-477d-a155-429ae701efc3 tempest-AttachVolumeNegativeTest-149954460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb" returned: 0 in 0.818s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-516e76b1-a64f-470d-9ec8-eb71b288382e req-3cb3a52c-cbd7-477d-a155-429ae701efc3 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.838s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-516e76b1-a64f-470d-9ec8-eb71b288382e req-3cb3a52c-cbd7-477d-a155-429ae701efc3 tempest-AttachVolumeNegativeTest-149954460 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '834c0881-397c-4e6b-ad43-919b89de9473', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:43:38 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-516e76b1-a64f-470d-9ec8-eb71b288382e req-3cb3a52c-cbd7-477d-a155-429ae701efc3 tempest-AttachVolumeNegativeTest-149954460 None] attachment_update completed successfully. Jul 05 02:43:44 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=54,cinder:UPDATE=48,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:43:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-ed2ae102-7707-423a-ad5b-f8dce493aa63 req-9c5f776b-2331-4527-896a-90536f0e078e tempest-AttachVolumeNegativeTest-149954460 None] Terminate volume connection completed successfully. Jul 05 02:43:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-ed2ae102-7707-423a-ad5b-f8dce493aa63 req-9c5f776b-2331-4527-896a-90536f0e078e tempest-AttachVolumeNegativeTest-149954460 None] Deleting attachment 834c0881-397c-4e6b-ad43-919b89de9473. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Flow 'volume_create_manager' (a861c26f-234a-4795-8293-7ed2a6363e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1b7a70-a5e6-41e7-a06c-4d83a4582125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1b7a70-a5e6-41e7-a06c-4d83a4582125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-350018147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c09d3669a88438999766157e7beec79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:47Z,use_quota=True,user_id='ba29b1087a65486795424e72aee60cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3deae6e7-3a2f-429e-99cf-d434729177c6),volume_type_id=3deae6e7-3a2f-429e-99cf-d434729177c6)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb398da7-d727-45d5-a9cb-6e7ecf2424b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb398da7-d727-45d5-a9cb-6e7ecf2424b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feba995e-c621-4d7f-bb4a-76cf3d1695c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feba995e-c621-4d7f-bb4a-76cf3d1695c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6', 'volume_name': 'volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc72c3d-3174-4448-84ed-7d0daf2337e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc72c3d-3174-4448-84ed-7d0daf2337e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b10751-0a3b-4889-8903-fa60ac234835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:47 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Volume c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6', 'volume_size': 1} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-350018147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c09d3669a88438999766157e7beec79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:47Z,use_quota=True,user_id='ba29b1087a65486795424e72aee60cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3deae6e7-3a2f-429e-99cf-d434729177c6),volume_type_id=3deae6e7-3a2f-429e-99cf-d434729177c6)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Creating volume c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:43:47 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:47 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 1073741824 Jul 05 02:43:47 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:47 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-4d6b3667-dd75-4c88-b838-885314130cca req-45cb1346-5277-4365-8cf4-9a7ae97a6b1d tempest-AttachVolumeTestJSON-563296492 None] Terminate volume connection completed successfully. Jul 05 02:43:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-4d6b3667-dd75-4c88-b838-885314130cca req-45cb1346-5277-4365-8cf4-9a7ae97a6b1d tempest-AttachVolumeTestJSON-563296492 None] Deleting attachment 389bb36c-d9e8-4636-93f3-c96f8a930e60. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:43:48 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 1073741824" returned: 0 in 0.952s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:48 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 Jul 05 02:43:48 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:48 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6" returned: 0 in 0.698s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:43:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b10751-0a3b-4889-8903-fa60ac234835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6c1034-73f7-43f4-a979-fe6e1cb78efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:48 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Volume volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 (c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6): created successfully Jul 05 02:43:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6c1034-73f7-43f4-a979-fe6e1cb78efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Flow 'volume_create_manager' (a861c26f-234a-4795-8293-7ed2a6363e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:48 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-18fd1eb5-e2b5-43b0-bf28-89fe155489b2 tempest-VolumeTypesAccessTest-792502249 None] Created volume successfully. Jul 05 02:43:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Acquiring lock "cinder-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:43:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Lock "cinder-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:43:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Acquiring lock "cinder-quobyte-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:43:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Lock "cinder-quobyte-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:43:49 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0b53e9-fde0-4df0-aa1d-903dce521f75]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:43:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:49 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 Jul 05 02:43:49 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6" returned: 0 in 0.970s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:50 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:50 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6 Jul 05 02:43:50 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:51 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6" returned: 0 in 0.863s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Lock "cinder-quobyte-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6" released by "delete_volume" :: held 1.889s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:43:51 devstack cinder-volume[86671]: WARNING cinder.quota [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1438678958 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1438678958, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:43:51 devstack cinder-volume[86671]: WARNING cinder.quota [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1438678958 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1438678958, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:43:51 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Created reservations ['c2977070-c4dc-47e7-8ffd-891902e41a81', 'a02e66fe-69c1-43f2-84cd-ca60ba3384cd', 'eb6a2b58-b882-49fa-bd7e-cde0f90a507a', 'cb9583ae-f8aa-4b63-95b7-532de3c99b80'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:43:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:51 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:43:51 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:52 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.692s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:52 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:43:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Deleted volume successfully. Jul 05 02:43:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91b25299-18e4-4d6e-bed7-7d9b1fb44edb tempest-VolumeTypesAccessTest-792502249 None] Lock "cinder-c9edfa2b-247b-4d7d-bcdd-9232fb54c9e6-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:43:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "cinder-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:43:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:43:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "cinder-quobyte-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:43:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-quobyte-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:43:55 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac79d62-7084-4f25-8773-f745a460a324]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:43:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:56 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb Jul 05 02:43:56 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:56 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb" returned: 0 in 0.894s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:56 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb Jul 05 02:43:56 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:57 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb" returned: 0 in 0.777s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-quobyte-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb" released by "delete_volume" :: held 1.717s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:43:57 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Created reservations ['a82c4043-7ffe-4b0f-a029-10c827d0d48c', 'a8737c4c-8ce8-461b-8831-042c1aaefbb5', '45ec2fc4-93e1-4d02-9cd0-059cb2952d58', 'c85ddbfa-d2d2-4446-a820-ff0293fd3601'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:43:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:43:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:43:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:43:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:43:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:43:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:57 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:43:57 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "cinder-df94c7af-d970-4cf3-8482-130a5dc467e6-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:43:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-df94c7af-d970-4cf3-8482-130a5dc467e6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:43:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "cinder-quobyte-df94c7af-d970-4cf3-8482-130a5dc467e6" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:43:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-quobyte-df94c7af-d970-4cf3-8482-130a5dc467e6" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:43:58 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3900995e-7304-473b-bd13-cf1dfc2e4325]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:43:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:43:58 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 Jul 05 02:43:58 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:43:59 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.175s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:43:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Deleted volume successfully. Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f604f6f8-581b-436b-a923-b38f4314cd47 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-a2c38af5-0cc1-4c08-a00d-475bfe29cdeb-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Flow 'volume_create_manager' (b132027f-1a7e-4a71-88fd-d921afd042d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9296d668-5565-4c6a-9583-5cbec0b22947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9296d668-5565-4c6a-9583-5cbec0b22947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-892126541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479b9305-ca45-4c38-800b-b1b5b7041836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5853c1aa745a45bca25c1fb0f09f7246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:59Z,use_quota=True,user_id='2caa4c26b2384716ae91f07b4d6ecf25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d770059-ef26-4299-9cea-86364d0acf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d770059-ef26-4299-9cea-86364d0acf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9aeb2d-3b73-4518-a110-3198dc4e896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:43:59 devstack cinder-volume[86671]: DEBUG cinder.image.glance [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Creating Keystone auth plugin from conf {{(pid=86671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 02:44:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9aeb2d-3b73-4518-a110-3198dc4e896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '479b9305-ca45-4c38-800b-b1b5b7041836', 'volume_name': 'volume-479b9305-ca45-4c38-800b-b1b5b7041836', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1524dcb1-ec5b-4fad-8800-108e2ddedebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1524dcb1-ec5b-4fad-8800-108e2ddedebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e53ec6-f670-493b-9a62-c5680ee8b665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:00 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Volume 479b9305-ca45-4c38-800b-b1b5b7041836: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-479b9305-ca45-4c38-800b-b1b5b7041836', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 02:44:00 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Trying to clone 479b9305-ca45-4c38-800b-b1b5b7041836 from image c1baa924-f45f-4a01-ae62-ac21392667fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]). {{(pid=86671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 05 02:44:00 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6" returned: 0 in 1.585s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:00 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6 Jul 05 02:44:00 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:00 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 02:44:00 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Image download 20.69 MB at 20.69 MB/s Jul 05 02:44:00 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ffc0fc-420c-4c46-b29b-7859bbc33109]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:01 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD Jul 05 02:44:01 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:01 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-df94c7af-d970-4cf3-8482-130a5dc467e6" returned: 0 in 0.903s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-quobyte-df94c7af-d970-4cf3-8482-130a5dc467e6" released by "delete_volume" :: held 2.570s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:01 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Created reservations ['7e0e9967-16e6-403c-a99e-68a4537106c7', '308b4e6d-7ee5-4c27-a540-5a28a21d514f', '68b4022e-6ebf-499d-b947-d086069dc0c8', '0e2b9647-94e8-4617-b295-2896c31f3746'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:44:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:01 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:44:01 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:02 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD" returned: 0 in 1.381s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:02 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Temporary image c1baa924-f45f-4a01-ae62-ac21392667fc is fetched for user 2caa4c26b2384716ae91f07b4d6ecf25. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 02:44:02 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8af611-4874-4cd3-801a-59f21ac9d2fa]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "cinder-7faeb3ed-ad05-49bf-94cb-6d2114a9f038-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-7faeb3ed-ad05-49bf-94cb-6d2114a9f038-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:02 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD Jul 05 02:44:02 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "cinder-quobyte-7faeb3ed-ad05-49bf-94cb-6d2114a9f038" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-quobyte-7faeb3ed-ad05-49bf-94cb-6d2114a9f038" acquired by "delete_volume" :: waited 0.034s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:02 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[321a90d6-aba8-4ce7-94c7-801a569ec6c9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:03 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.724s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:03 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:44:03 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 Jul 05 02:44:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Deleted volume successfully. Jul 05 02:44:03 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a9d55c16-e218-4d44-ab6a-40f4778455b9 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-df94c7af-d970-4cf3-8482-130a5dc467e6-delete_volume" released by "delete_volume" :: held 4.674s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:04 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD" returned: 0 in 1.664s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-892126541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479b9305-ca45-4c38-800b-b1b5b7041836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5853c1aa745a45bca25c1fb0f09f7246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:43:59Z,use_quota=True,user_id='2caa4c26b2384716ae91f07b4d6ecf25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Creating volume 479b9305-ca45-4c38-800b-b1b5b7041836 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:44:04 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:04 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 1073741824 Jul 05 02:44:04 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:04 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038" returned: 0 in 1.546s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:04 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038 Jul 05 02:44:04 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:05 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:44:05 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:05 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 1073741824" returned: 0 in 1.272s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:05 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7faeb3ed-ad05-49bf-94cb-6d2114a9f038" returned: 0 in 1.029s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-quobyte-7faeb3ed-ad05-49bf-94cb-6d2114a9f038" released by "delete_volume" :: held 2.715s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:05 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 Jul 05 02:44:05 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Created reservations ['22336494-23be-4a8d-a1d8-1dc36b2e4b16', 'bd022bf8-6462-4289-aa47-cbd9e2ea65de', 'b5d1f440-8284-41ae-8b0e-521ab7b0128d', '587d730f-fa4e-45fe-86c5-416e19c7b46a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:05 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:44:05 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:06 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.296s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:44:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:44:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:44:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:44:07 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836" returned: 0 in 1.590s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] <== create_volume: return (2969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:44:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.975s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:07 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Attempting download of c1baa924-f45f-4a01-ae62-ac21392667fc ((None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}])) to volume 479b9305-ca45-4c38-800b-b1b5b7041836. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 02:44:07 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.439s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:07 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:44:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Deleted volume successfully. Jul 05 02:44:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fac3e6ba-74a5-41ec-8900-8b314623b0a5 tempest-AttachVolumeNegativeTest-149954460 None] Lock "cinder-7faeb3ed-ad05-49bf-94cb-6d2114a9f038-delete_volume" released by "delete_volume" :: held 4.598s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:07 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc77f7f-8da7-478b-b0e3-f1477e853feb]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_egqa7aok {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:07 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_egqa7aok Jul 05 02:44:07 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:08 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_egqa7aok" returned: 0 in 0.907s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_egqa7aok {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:08 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_egqa7aok Jul 05 02:44:08 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:09 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_egqa7aok" returned: 1 in 0.916s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_egqa7aok' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:44:09 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[62298057-5063-4171-b94f-d4ba0e103991]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:09 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD Jul 05 02:44:09 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:10 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD" returned: 0 in 1.206s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:10 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] c1baa924-f45f-4a01-ae62-ac21392667fc was qcow2, converting to raw {{(pid=86671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 02:44:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:10 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 Jul 05 02:44:10 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836" returned: 0 in 2.703s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:12 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_gwlu8b_9devstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:44:12 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Converted 112.00 MB image at 41.40 MB/s Jul 05 02:44:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:12 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:13 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 1G Jul 05 02:44:13 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:13 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 1G" returned: 0 in 0.979s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:14 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeb77fe-e830-4da3-85e3-0934352f186a]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:14 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 Jul 05 02:44:14 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:14 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836" returned: 0 in 0.844s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:14 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 Jul 05 02:44:14 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Flow 'volume_create_manager' (3365d936-5523-47c3-8e7b-a81ea1d74d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993a8a91-7107-46ca-bbc1-5c504ceee826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=61,cinder:UPDATE=74,cinder:INSERT=14,cinder:DELETE=9 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993a8a91-7107-46ca-bbc1-5c504ceee826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2044255905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63fcbe4-c90e-46ac-b971-b491b7c65ab2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b82f0228e2264379927f55e969ce82f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:16Z,use_quota=True,user_id='cbedc3b4f02a4290aada6dfce3b73867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765678d1-32b5-4986-8ba0-a7c6bd44225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765678d1-32b5-4986-8ba0-a7c6bd44225b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd39cfd5-bcd8-4726-8878-3c614a614a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd39cfd5-bcd8-4726-8878-3c614a614a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c63fcbe4-c90e-46ac-b971-b491b7c65ab2', 'volume_name': 'volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49abcc3-cd6c-40aa-b4d4-976e419ca436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49abcc3-cd6c-40aa-b4d4-976e419ca436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810fe366-4f37-4ee9-9b98-5f90440f8ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:15 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Volume c63fcbe4-c90e-46ac-b971-b491b7c65ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2', 'volume_size': 1} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2044255905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63fcbe4-c90e-46ac-b971-b491b7c65ab2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b82f0228e2264379927f55e969ce82f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:16Z,use_quota=True,user_id='cbedc3b4f02a4290aada6dfce3b73867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Creating volume c63fcbe4-c90e-46ac-b971-b491b7c65ab2 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:44:15 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:15 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836" returned: 1 in 0.843s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Downloaded image c1baa924-f45f-4a01-ae62-ac21392667fc ((None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}])) to volume 479b9305-ca45-4c38-800b-b1b5b7041836 successfully. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Temporary image c1baa924-f45f-4a01-ae62-ac21392667fc for user 2caa4c26b2384716ae91f07b4d6ecf25 is deleted. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Marking volume 479b9305-ca45-4c38-800b-b1b5b7041836 as bootable. {{(pid=86671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 02:44:15 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2 1073741824 Jul 05 02:44:15 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Copying metadata from image c1baa924-f45f-4a01-ae62-ac21392667fc to 479b9305-ca45-4c38-800b-b1b5b7041836. {{(pid=86671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Creating volume glance metadata for volume 479b9305-ca45-4c38-800b-b1b5b7041836 backed by image c1baa924-f45f-4a01-ae62-ac21392667fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e53ec6-f670-493b-9a62-c5680ee8b665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479b9305-ca45-4c38-800b-b1b5b7041836', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d730f4b9-3814-4c0c-9d03-0bdf56067886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:15 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Volume volume-479b9305-ca45-4c38-800b-b1b5b7041836 (479b9305-ca45-4c38-800b-b1b5b7041836): created successfully Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d730f4b9-3814-4c0c-9d03-0bdf56067886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Flow 'volume_create_manager' (b132027f-1a7e-4a71-88fd-d921afd042d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:15 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-be1d98a8-45b2-4e8b-831d-5120cd80454d tempest-VolumesImageMetadata-549693620 None] Created volume successfully. Jul 05 02:44:16 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2 1073741824" returned: 0 in 0.959s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:16 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2 Jul 05 02:44:16 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Acquiring lock "cinder-479b9305-ca45-4c38-800b-b1b5b7041836-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Lock "cinder-479b9305-ca45-4c38-800b-b1b5b7041836-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Acquiring lock "cinder-quobyte-479b9305-ca45-4c38-800b-b1b5b7041836" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Lock "cinder-quobyte-479b9305-ca45-4c38-800b-b1b5b7041836" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a56eaed-42b0-4159-a1a0-0f412f3ea4ee]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:17 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 Jul 05 02:44:17 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:17 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2" returned: 0 in 0.726s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810fe366-4f37-4ee9-9b98-5f90440f8ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45b5210-23f5-4718-a927-8cd85cdd9de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:17 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Volume volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2 (c63fcbe4-c90e-46ac-b971-b491b7c65ab2): created successfully Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45b5210-23f5-4718-a927-8cd85cdd9de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Flow 'volume_create_manager' (3365d936-5523-47c3-8e7b-a81ea1d74d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:17 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ad64387e-93c8-4e3d-ab8c-4e62392d55a0 tempest-VolumesTestJSON-2028725783 None] Created volume successfully. Jul 05 02:44:17 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836" returned: 0 in 0.805s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:17 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 Jul 05 02:44:17 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Flow 'volume_create_manager' (c9fb1a34-6e83-43a4-9e11-98e4964e2660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f2d9cf-b779-47b2-937c-a4dae85905db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f2d9cf-b779-47b2-937c-a4dae85905db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1110834412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64eb0465-d7f6-471b-b47f-0a14dadaff42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b82f0228e2264379927f55e969ce82f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:18Z,use_quota=True,user_id='cbedc3b4f02a4290aada6dfce3b73867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfe083e-edfd-48b2-b28e-b995eb2639ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfe083e-edfd-48b2-b28e-b995eb2639ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a1352f-50fd-4bf8-97d7-69c9111fe20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a1352f-50fd-4bf8-97d7-69c9111fe20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64eb0465-d7f6-471b-b47f-0a14dadaff42', 'volume_name': 'volume-64eb0465-d7f6-471b-b47f-0a14dadaff42', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f2a6e8-c268-49fe-a31a-a0f4d009f6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f2a6e8-c268-49fe-a31a-a0f4d009f6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3715060e-c5fb-4013-a27c-f07c8cbe396c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:18 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Volume 64eb0465-d7f6-471b-b47f-0a14dadaff42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64eb0465-d7f6-471b-b47f-0a14dadaff42', 'volume_size': 1} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1110834412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64eb0465-d7f6-471b-b47f-0a14dadaff42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b82f0228e2264379927f55e969ce82f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:18Z,use_quota=True,user_id='cbedc3b4f02a4290aada6dfce3b73867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Creating volume 64eb0465-d7f6-471b-b47f-0a14dadaff42 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:44:18 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:18 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42 1073741824 Jul 05 02:44:18 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:18 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836" returned: 1 in 0.808s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:44:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:18 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836 Jul 05 02:44:18 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:19 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42 1073741824" returned: 0 in 1.003s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:19 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42 Jul 05 02:44:19 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:19 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-479b9305-ca45-4c38-800b-b1b5b7041836" returned: 0 in 0.799s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Lock "cinder-quobyte-479b9305-ca45-4c38-800b-b1b5b7041836" released by "delete_volume" :: held 2.485s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Created reservations ['c7bf1e2a-9093-4729-a1e8-9d61c9861be4', 'ed1036a5-bed5-48a7-9e76-64cc8b7e7720', 'ad270f40-2142-4c64-b73f-bb0ba2a3de53', '0568ac2d-5642-414a-b053-1c4be9372bdb'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:19 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:44:19 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:20 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42" returned: 0 in 0.707s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3715060e-c5fb-4013-a27c-f07c8cbe396c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64eb0465-d7f6-471b-b47f-0a14dadaff42', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a407088-d8bc-4612-84c6-27fedea9210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:20 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Volume volume-64eb0465-d7f6-471b-b47f-0a14dadaff42 (64eb0465-d7f6-471b-b47f-0a14dadaff42): created successfully Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a407088-d8bc-4612-84c6-27fedea9210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Flow 'volume_create_manager' (c9fb1a34-6e83-43a4-9e11-98e4964e2660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-28f968b9-fc24-42d6-8987-acf4b8cd338c tempest-VolumesTestJSON-2028725783 None] Created volume successfully. Jul 05 02:44:20 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.693s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:44:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Deleted volume successfully. Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5aba3e2-f685-4f75-b67f-483bc3a275b7 tempest-VolumesImageMetadata-549693620 None] Lock "cinder-479b9305-ca45-4c38-800b-b1b5b7041836-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Flow 'volume_create_manager' (40a42d3e-1e98-4e67-b1aa-462d0f225b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ee84d4-d7bd-4ad1-b85a-1c20989b1b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ee84d4-d7bd-4ad1-b85a-1c20989b1b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1198863106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca36fd22-e9ba-4b84-828d-2a3014417c73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b82f0228e2264379927f55e969ce82f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:21Z,use_quota=True,user_id='cbedc3b4f02a4290aada6dfce3b73867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fda5ef-9ab5-4cab-a7a4-a5e9013ff61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fda5ef-9ab5-4cab-a7a4-a5e9013ff61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfa678c-7336-4cec-9cfa-c7b0fa066a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfa678c-7336-4cec-9cfa-c7b0fa066a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca36fd22-e9ba-4b84-828d-2a3014417c73', 'volume_name': 'volume-ca36fd22-e9ba-4b84-828d-2a3014417c73', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936ebb6a-79fe-4f7c-a74d-2e0c2b8edf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936ebb6a-79fe-4f7c-a74d-2e0c2b8edf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8714b8da-420e-44a2-94d3-1cfbb44b657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:20 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Volume ca36fd22-e9ba-4b84-828d-2a3014417c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca36fd22-e9ba-4b84-828d-2a3014417c73', 'volume_size': 1} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1198863106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca36fd22-e9ba-4b84-828d-2a3014417c73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b82f0228e2264379927f55e969ce82f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:21Z,use_quota=True,user_id='cbedc3b4f02a4290aada6dfce3b73867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Creating volume ca36fd22-e9ba-4b84-828d-2a3014417c73 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:44:20 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:44:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:20 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73 1073741824 Jul 05 02:44:20 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:21 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73 1073741824" returned: 0 in 1.027s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:22 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73 Jul 05 02:44:22 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:22 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73" returned: 0 in 0.799s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:44:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8714b8da-420e-44a2-94d3-1cfbb44b657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca36fd22-e9ba-4b84-828d-2a3014417c73', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf56b09-128b-402c-bf3c-297562481dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:22 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Volume volume-ca36fd22-e9ba-4b84-828d-2a3014417c73 (ca36fd22-e9ba-4b84-828d-2a3014417c73): created successfully Jul 05 02:44:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf56b09-128b-402c-bf3c-297562481dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Flow 'volume_create_manager' (40a42d3e-1e98-4e67-b1aa-462d0f225b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:22 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-89535e85-469c-43e9-8f2f-ad7cbf5c0fe5 tempest-VolumesTestJSON-2028725783 None] Created volume successfully. Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Flow 'volume_create_manager' (f39ebe35-d614-488c-9a89-b5bed3f98037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc77a2c4-c0c9-49e2-aa6c-83e4f060bd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc77a2c4-c0c9-49e2-aa6c-83e4f060bd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-708316377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61b640e-6a88-4959-8dc6-a6c6f266ed8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5931be72a1f42e29ac29be8dfc3fd11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:24Z,use_quota=True,user_id='67c02eb3a30c485b978d26760dded913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f48ba09-6fdc-44b5-a836-ea3f5f4861c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f48ba09-6fdc-44b5-a836-ea3f5f4861c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a6cfb4-b103-4a81-a803-2b69fb3a9cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a6cfb4-b103-4a81-a803-2b69fb3a9cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd61b640e-6a88-4959-8dc6-a6c6f266ed8c', 'volume_name': 'volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655d3dca-8802-4f83-ad41-e0da4156811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655d3dca-8802-4f83-ad41-e0da4156811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3072d6e-e9d5-4a6b-997a-00f20c033064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:23 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Volume d61b640e-6a88-4959-8dc6-a6c6f266ed8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c', 'volume_size': 1} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-708316377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61b640e-6a88-4959-8dc6-a6c6f266ed8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5931be72a1f42e29ac29be8dfc3fd11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:24Z,use_quota=True,user_id='67c02eb3a30c485b978d26760dded913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Creating volume d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:44:23 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:44:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:23 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c 1073741824 Jul 05 02:44:23 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:24 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c 1073741824" returned: 0 in 1.099s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:24 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c Jul 05 02:44:24 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-cb8a2be7-1c99-4dc3-b49f-7a54f495119c req-16a57df1-3814-4df7-8364-1de2ee386651 tempest-TestMinimumBasicScenario-373829211 None] Terminate volume connection completed successfully. Jul 05 02:44:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-cb8a2be7-1c99-4dc3-b49f-7a54f495119c req-16a57df1-3814-4df7-8364-1de2ee386651 tempest-TestMinimumBasicScenario-373829211 None] Deleting attachment 95857b6e-b94a-4eca-b37f-b552087ff709. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Acquiring lock "cinder-ca36fd22-e9ba-4b84-828d-2a3014417c73-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Lock "cinder-ca36fd22-e9ba-4b84-828d-2a3014417c73-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Acquiring lock "cinder-quobyte-ca36fd22-e9ba-4b84-828d-2a3014417c73" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Lock "cinder-quobyte-ca36fd22-e9ba-4b84-828d-2a3014417c73" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0f217c-85d3-447d-a492-b3b4ef258961]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:25 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73 Jul 05 02:44:25 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:25 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" returned: 0 in 0.738s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3072d6e-e9d5-4a6b-997a-00f20c033064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c01f24-7537-4c7b-991f-debde585c5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:25 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Volume volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c (d61b640e-6a88-4959-8dc6-a6c6f266ed8c): created successfully Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c01f24-7537-4c7b-991f-debde585c5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Flow 'volume_create_manager' (f39ebe35-d614-488c-9a89-b5bed3f98037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:25 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8fb54614-7693-4b10-ac67-3e5cc27e04b3 tempest-VolumesDeleteCascade-1503406792 None] Created volume successfully. Jul 05 02:44:26 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73" returned: 0 in 0.782s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:26 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73 Jul 05 02:44:26 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:26 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca36fd22-e9ba-4b84-828d-2a3014417c73" returned: 0 in 0.675s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Lock "cinder-quobyte-ca36fd22-e9ba-4b84-828d-2a3014417c73" released by "delete_volume" :: held 1.504s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Created reservations ['cf500610-fdf0-48a6-b0d6-ab7a89e81b79', '666d849d-d732-4f91-8af0-c08f1e42327f', '2aeef0da-70ab-45b3-9954-24f34197bfde', 'd8f4814e-8fce-4be0-b5bb-d4040d1029aa'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Acquiring lock "cinder-8cc0852a-92b1-4abb-825b-3431df4eada6-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Lock "cinder-8cc0852a-92b1-4abb-825b-3431df4eada6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Acquiring lock "cinder-quobyte-8cc0852a-92b1-4abb-825b-3431df4eada6" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:27 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:44:27 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Lock "cinder-quobyte-8cc0852a-92b1-4abb-825b-3431df4eada6" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[72df8b91-f75e-4238-a3bb-028ae03f979b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Creating offline snapshot 3d16902e-5608-4d9e-9067-3b5f9d287a64 of volume d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a6a1f8-2a8b-4604-bc73-b0b8be90444e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:27 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 Jul 05 02:44:27 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:27 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c Jul 05 02:44:27 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Acquiring lock "cinder-64eb0465-d7f6-471b-b47f-0a14dadaff42-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Lock "cinder-64eb0465-d7f6-471b-b47f-0a14dadaff42-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Acquiring lock "cinder-quobyte-64eb0465-d7f6-471b-b47f-0a14dadaff42" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Lock "cinder-quobyte-64eb0465-d7f6-471b-b47f-0a14dadaff42" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a76e251-5a43-4814-badd-def0b1ee2ff8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:27 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42 Jul 05 02:44:27 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:27 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.755s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:44:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Deleted volume successfully. Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c06a500b-013b-4eb5-81b1-a0e21932791c tempest-VolumesTestJSON-2028725783 None] Lock "cinder-ca36fd22-e9ba-4b84-828d-2a3014417c73-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:27 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6" returned: 0 in 0.918s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:28 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6 Jul 05 02:44:28 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:28 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" returned: 0 in 0.948s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:28 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 1G Jul 05 02:44:28 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:28 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42" returned: 0 in 0.895s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:28 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42 Jul 05 02:44:28 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:28 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8cc0852a-92b1-4abb-825b-3431df4eada6" returned: 0 in 0.769s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Lock "cinder-quobyte-8cc0852a-92b1-4abb-825b-3431df4eada6" released by "delete_volume" :: held 1.782s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:28 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Created reservations ['29bb580b-cf13-4e66-b173-a44a352037d0', '76a7f032-3196-45d9-b66f-44c3bb69f109', '796d3f1d-ec78-4be4-b4b7-9ab1239af862', 'a24eef43-3f34-491a-bc02-37ea209a6421'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:29 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:44:29 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:29 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 1G" returned: 0 in 1.197s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:29 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 Jul 05 02:44:29 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:29 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-64eb0465-d7f6-471b-b47f-0a14dadaff42" returned: 0 in 1.180s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Lock "cinder-quobyte-64eb0465-d7f6-471b-b47f-0a14dadaff42" released by "delete_volume" :: held 2.121s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Created reservations ['2165947c-faf2-4e63-9099-ea48e9b13a10', '5d3eef79-428a-4a0e-bcef-8f71fdc50ba9', 'c40ad500-911b-4461-bb44-5d929140f26f', 'e142d119-c228-4f9d-86f3-2c18aa9b3e1a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:29 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:44:29 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:30 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.213s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:44:30 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Deleted volume successfully. Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1c8916a-5494-431b-9846-1468e8bcdb2b tempest-TestMinimumBasicScenario-373829211 None] Lock "cinder-8cc0852a-92b1-4abb-825b-3431df4eada6-delete_volume" released by "delete_volume" :: held 3.386s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:30 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64" returned: 0 in 1.019s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:30 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 is being set with open permissions: ugo+rw Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:30 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 Jul 05 02:44:30 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Acquiring lock "cinder-c63fcbe4-c90e-46ac-b971-b491b7c65ab2-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:30 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.893s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Lock "cinder-c63fcbe4-c90e-46ac-b971-b491b7c65ab2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:30 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Deleted volume successfully. Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b4c18a9-110b-4ac7-bf2c-63246e468903 tempest-VolumesTestJSON-2028725783 None] Lock "cinder-64eb0465-d7f6-471b-b47f-0a14dadaff42-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Acquiring lock "cinder-quobyte-c63fcbe4-c90e-46ac-b971-b491b7c65ab2" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Lock "cinder-quobyte-c63fcbe4-c90e-46ac-b971-b491b7c65ab2" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[917731e2-0d3c-426d-adcc-39d6f5f7b83e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:30 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2 Jul 05 02:44:30 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:31 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64" returned: 0 in 0.763s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:31 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.info Jul 05 02:44:31 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:32 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.info" returned: 0 in 0.921s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:32 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.info is being set with open permissions: ugo+rw Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:32 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2" returned: 0 in 1.169s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:32 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.info Jul 05 02:44:32 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:32 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2 Jul 05 02:44:32 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:32 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.info" returned: 0 in 0.748s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.722s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:32 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4771dd66-40f2-4193-b829-938af88b552b tempest-VolumesDeleteCascade-1503406792 None] Create snapshot completed successfully Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c63fcbe4-c90e-46ac-b971-b491b7c65ab2" returned: 0 in 0.789s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Lock "cinder-quobyte-c63fcbe4-c90e-46ac-b971-b491b7c65ab2" released by "delete_volume" :: held 2.005s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Created reservations ['43834053-2e44-4c28-9e25-3dce11b7fd52', 'b52ad725-88a1-4561-9cc5-264637f7492d', 'c17aba6f-9877-47ec-963e-11e2142a167b', '2dff3c01-d8d8-4ae5-afe0-ceb3ad3e0c62'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:33 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:44:33 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] Creating offline snapshot 5d5c7217-ced1-469a-a401-d0238e28269d of volume d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:44:33 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9306664-7bc6-4160-af1f-795fa984e3b1]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:33 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.813s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:33 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:44:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Deleted volume successfully. Jul 05 02:44:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc3d5a28-d07b-4a35-aff6-a7c934e71518 tempest-VolumesTestJSON-2028725783 None] Lock "cinder-c63fcbe4-c90e-46ac-b971-b491b7c65ab2-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:33 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 Jul 05 02:44:33 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:34 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64" returned: 0 in 0.910s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:44:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:34 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d 1G Jul 05 02:44:34 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:35 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d 1G" returned: 0 in 0.982s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:35 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d Jul 05 02:44:35 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:36 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d" returned: 0 in 0.957s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:36 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d is being set with open permissions: ugo+rw Jul 05 02:44:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:36 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d Jul 05 02:44:36 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:37 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d" returned: 0 in 0.873s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.896s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:37 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-724d06d0-ff3d-4287-a8a3-2ca8d9d5ab2c tempest-VolumesDeleteCascade-1503406792 None] Create snapshot completed successfully Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Flow 'volume_create_manager' (5352a581-7ba8-4062-b0b8-6c19e2c98baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc32408-ae42-4caa-9375-9b05cbc1e728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc32408-ae42-4caa-9375-9b05cbc1e728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-346826325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934c26db-c2d3-4904-8700-ced315903273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34507af1fc3949c889b3543883e9449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:38Z,use_quota=True,user_id='75cdae4639684a9aa2f5696730e7f92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a344213f-3758-473b-9e0d-7749a22ce03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a344213f-3758-473b-9e0d-7749a22ce03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9465c4f-9f59-4123-a434-c71e6831afd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9465c4f-9f59-4123-a434-c71e6831afd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934c26db-c2d3-4904-8700-ced315903273', 'volume_name': 'volume-934c26db-c2d3-4904-8700-ced315903273', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9618f6d9-37ab-4391-8efc-8cf6de431d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9618f6d9-37ab-4391-8efc-8cf6de431d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc891f9a-bfe4-4f3d-a2bd-b5e19bc46a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:37 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Volume 934c26db-c2d3-4904-8700-ced315903273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934c26db-c2d3-4904-8700-ced315903273', 'volume_size': 1} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-346826325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934c26db-c2d3-4904-8700-ced315903273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34507af1fc3949c889b3543883e9449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:38Z,use_quota=True,user_id='75cdae4639684a9aa2f5696730e7f92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Creating volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:44:37 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:44:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-d61b640e-6a88-4959-8dc6-a6c6f266ed8c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:38 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 1073741824 Jul 05 02:44:38 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-d61b640e-6a88-4959-8dc6-a6c6f266ed8c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Performing cascade delete. {{(pid=86671) delete_volume /opt/stack/cinder/cinder/volume/manager.py:997}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-3d16902e-5608-4d9e-9067-3b5f9d287a64-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-3d16902e-5608-4d9e-9067-3b5f9d287a64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-3d16902e-5608-4d9e-9067-3b5f9d287a64" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-3d16902e-5608-4d9e-9067-3b5f9d287a64" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Deleting offline snapshot 3d16902e-5608-4d9e-9067-3b5f9d287a64 of volume d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] snapshot_file for this snap is: volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6ac6e6-f2d1-4162-8a5b-7778b48b9645]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:38 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 Jul 05 02:44:38 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:39 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 1073741824" returned: 0 in 1.120s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:39 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 Jul 05 02:44:39 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:39 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64" returned: 0 in 0.951s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:44:39 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8471126d-210d-4ac1-bb0c-76e4185cd29e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:39 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c Jul 05 02:44:39 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:40 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273" returned: 0 in 0.836s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:44:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc891f9a-bfe4-4f3d-a2bd-b5e19bc46a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934c26db-c2d3-4904-8700-ced315903273', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ab9ba5-7086-42da-b13c-646e42e83d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:40 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Volume volume-934c26db-c2d3-4904-8700-ced315903273 (934c26db-c2d3-4904-8700-ced315903273): created successfully Jul 05 02:44:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ab9ba5-7086-42da-b13c-646e42e83d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Flow 'volume_create_manager' (5352a581-7ba8-4062-b0b8-6c19e2c98baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-fefc6409-1978-4811-9817-7377d4af81e0 tempest-SnapshotsActionsTest-38370347 None] Created volume successfully. Jul 05 02:44:40 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" returned: 0 in 1.122s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:40 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6258975f-d2f8-4cf2-8910-5d4f6ecc3fa8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:40 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d Jul 05 02:44:40 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Creating offline snapshot d1182977-d58c-46b0-ae86-ec8beefe6870 of volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:44:41 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[323089b8-1ec6-46a5-8387-f8081109eeb0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:41 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d" returned: 0 in 1.010s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:44:41 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb90a864-00fa-48b3-8795-e1be509a06f7]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:41 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 Jul 05 02:44:41 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:41 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 Jul 05 02:44:41 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:42 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273" returned: 0 in 0.918s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:42 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64" returned: 0 in 0.905s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:44:42 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 1G Jul 05 02:44:42 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:42 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[be91087d-c72e-4c33-92de-ccf923ecd12d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:42 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c Jul 05 02:44:42 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:43 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" returned: 0 in 0.870s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:43 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 1G" returned: 0 in 0.943s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:43 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 Jul 05 02:44:43 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:43 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:44:43 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:44 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 0.819s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:44 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 is being set with open permissions: ugo+rw Jul 05 02:44:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:44 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64" returned: 0 in 0.862s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:44 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:44:44 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:44 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64 Jul 05 02:44:44 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:44 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 0.888s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:45 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=99,cinder:SELECT=69,cinder:INSERT=34,cinder:DELETE=9 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:44:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:45 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.info Jul 05 02:44:45 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:45 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.3d16902e-5608-4d9e-9067-3b5f9d287a64" returned: 0 in 0.975s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d -F qcow2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:45 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d -F qcow2 Jul 05 02:44:45 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:46 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.info" returned: 0 in 0.956s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:46 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.info is being set with open permissions: ugo+rw Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:46 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.info Jul 05 02:44:46 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:46 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d -F qcow2" returned: 0 in 1.086s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-3d16902e-5608-4d9e-9067-3b5f9d287a64" released by "_delete_snapshot" :: held 8.063s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" released by "delete_snapshot" :: held 8.098s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Created reservations ['adad02a7-1a98-4732-b376-7b69ef5a9556', 'c204abd0-4a28-42e5-a219-078dce0d0ca0', 'ae2b7bd5-10f6-4059-952e-7d2cdc53ac80', '34ebdff8-913a-445a-a3f1-82c4cd9ee836'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:44:46 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Delete snapshot completed successfully. Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-3d16902e-5608-4d9e-9067-3b5f9d287a64-delete_snapshot" released by "delete_snapshot" :: held 8.315s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-5d5c7217-ced1-469a-a401-d0238e28269d-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-5d5c7217-ced1-469a-a401-d0238e28269d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-5d5c7217-ced1-469a-a401-d0238e28269d" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-5d5c7217-ced1-469a-a401-d0238e28269d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Deleting offline snapshot 5d5c7217-ced1-469a-a401-d0238e28269d of volume d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] snapshot_file for this snap is: volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a2d2ab-62ae-4be1-8948-28b36332d71e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:46 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d Jul 05 02:44:46 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:47 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.info" returned: 0 in 1.081s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.745s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:47 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8e587bc9-000f-4dc0-9f6a-f3de3b73aeb8 tempest-SnapshotsActionsTest-38370347 None] Create snapshot completed successfully Jul 05 02:44:47 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d" returned: 0 in 1.127s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:44:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e789047f-91b1-442e-91e6-5751dc250990]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:47 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c Jul 05 02:44:47 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] Creating offline snapshot 47da6d7b-ac69-4d17-9181-d44fa7321d86 of volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:44:48 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6292b5-2952-4508-b6ba-cbbc05d522f4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:48 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" returned: 0 in 0.948s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:48 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d Jul 05 02:44:48 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:48 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:44:48 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:49 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 0.812s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:44:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:49 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d" returned: 0 in 0.793s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:49 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 1G Jul 05 02:44:49 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:49 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d Jul 05 02:44:49 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:50 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c.5d5c7217-ced1-469a-a401-d0238e28269d" returned: 0 in 0.846s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-5d5c7217-ced1-469a-a401-d0238e28269d" released by "_delete_snapshot" :: held 3.854s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" released by "delete_snapshot" :: held 3.888s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Created reservations ['373e762a-8a8b-446f-80ee-662f95aab271', '11d3eb45-349e-4499-bbbe-a163c425e5c8', '60ffb367-a43b-4263-a59e-a7b58c80de6f', 'efa93d5f-9984-4611-a571-3327a7873025'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:44:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Delete snapshot completed successfully. Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-5d5c7217-ced1-469a-a401-d0238e28269d-delete_snapshot" released by "delete_snapshot" :: held 4.103s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Snapshots deleted, issuing volume delete {{(pid=86671) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1012}} Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" acquired by "delete_volume" :: waited 0.012s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f521094c-0c05-425d-8cd1-e184af44b166]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:50 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 1G" returned: 0 in 1.162s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:50 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 Jul 05 02:44:50 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:50 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c Jul 05 02:44:50 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:51 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" returned: 0 in 1.231s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:51 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86" returned: 0 in 1.231s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:51 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 is being set with open permissions: ugo+rw Jul 05 02:44:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:51 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c Jul 05 02:44:51 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:51 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 Jul 05 02:44:51 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:52 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86" returned: 0 in 0.912s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:52 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.242s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" returned: 0 in 0.989s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-d61b640e-6a88-4959-8dc6-a6c6f266ed8c" released by "delete_volume" :: held 2.315s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ffd14c94-8ada-4f49-afec-43989ffdc96b tempest-SnapshotsActionsTest-38370347 None] Create snapshot completed successfully Jul 05 02:44:52 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Created reservations ['e8725600-29e8-4a8a-9da4-aed2450c1eef', '37f9185c-b7e7-496c-9295-a11e2a0e7403', 'fc27941b-9254-469d-97b0-e4436c224a0d', 'f5f9a4d2-0d36-4984-ac3e-7be10599f3d0'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:44:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:53 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:44:53 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:53 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.744s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:53 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:44:53 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Deleted volume successfully. Jul 05 02:44:53 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8216b705-0c55-4069-9a39-fa69e7532b84 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-d61b640e-6a88-4959-8dc6-a6c6f266ed8c-delete_volume" released by "delete_volume" :: held 15.861s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Flow 'volume_create_manager' (5fd3b821-c079-4510-babb-901ae99da09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72852340-0fd3-4eaf-b7af-a127dcce83ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72852340-0fd3-4eaf-b7af-a127dcce83ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1514672917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eab7355-d961-4f9f-b140-930f9331b570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5931be72a1f42e29ac29be8dfc3fd11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:54Z,use_quota=True,user_id='67c02eb3a30c485b978d26760dded913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ac47fd-a396-4c8e-b597-e48d5e3d10d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ac47fd-a396-4c8e-b597-e48d5e3d10d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb54452-013f-448f-9eb3-49f054bc3e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb54452-013f-448f-9eb3-49f054bc3e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eab7355-d961-4f9f-b140-930f9331b570', 'volume_name': 'volume-0eab7355-d961-4f9f-b140-930f9331b570', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd32e73-64b2-4cc9-a154-736737d4364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd32e73-64b2-4cc9-a154-736737d4364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b58878-c61b-4ada-ab22-5e0d37ea950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:54 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Volume 0eab7355-d961-4f9f-b140-930f9331b570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eab7355-d961-4f9f-b140-930f9331b570', 'volume_size': 1} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1514672917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eab7355-d961-4f9f-b140-930f9331b570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5931be72a1f42e29ac29be8dfc3fd11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:44:54Z,use_quota=True,user_id='67c02eb3a30c485b978d26760dded913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Creating volume 0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:44:54 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-47da6d7b-ac69-4d17-9181-d44fa7321d86-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:54 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 1073741824 Jul 05 02:44:54 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-47da6d7b-ac69-4d17-9181-d44fa7321d86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-quobyte-47da6d7b-ac69-4d17-9181-d44fa7321d86" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-47da6d7b-ac69-4d17-9181-d44fa7321d86" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Deleting offline snapshot 47da6d7b-ac69-4d17-9181-d44fa7321d86 of volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] snapshot_file for this snap is: volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[528dc74f-df1f-4fda-b421-10e1e68ff742]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:54 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 Jul 05 02:44:54 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:55 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 1073741824" returned: 0 in 1.180s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:55 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 Jul 05 02:44:55 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:55 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86" returned: 0 in 1.227s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:44:55 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c024c61c-03eb-467e-a95a-55c5cfa54397]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:56 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:44:56 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:57 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570" returned: 0 in 1.477s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] <== create_volume: return (2734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.736s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b58878-c61b-4ada-ab22-5e0d37ea950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eab7355-d961-4f9f-b140-930f9331b570', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce521c8-1a6a-497d-a9a6-3c57df2a13d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:44:57 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Volume volume-0eab7355-d961-4f9f-b140-930f9331b570 (0eab7355-d961-4f9f-b140-930f9331b570): created successfully Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce521c8-1a6a-497d-a9a6-3c57df2a13d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Flow 'volume_create_manager' (5fd3b821-c079-4510-babb-901ae99da09b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:44:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-062bff23-55c0-4e70-95d5-890902669b39 tempest-VolumesDeleteCascade-1503406792 None] Created volume successfully. Jul 05 02:44:57 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 1.593s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:57 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 Jul 05 02:44:57 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:44:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:44:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Creating offline snapshot 3cf8f40d-442a-4431-8ada-c16986ece9c1 of volume 0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:44:58 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2e2178-96ef-4464-9ad6-80ed52d535fe]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:44:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:58 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 Jul 05 02:44:58 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:58 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86" returned: 0 in 1.491s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:59 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86 Jul 05 02:44:59 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:44:59 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 05 02:44:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570" returned: 0 in 1.435s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:44:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:44:59 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 1G Jul 05 02:44:59 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:00 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.47da6d7b-ac69-4d17-9181-d44fa7321d86" returned: 0 in 1.105s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-47da6d7b-ac69-4d17-9181-d44fa7321d86" released by "_delete_snapshot" :: held 5.640s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" released by "delete_snapshot" :: held 5.688s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:00 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Created reservations ['96189f89-d0f4-49bb-83f8-d998f93ffd4e', 'ec30c390-287d-466b-83ea-5c03a65ead87', '16a70efc-4d4f-42aa-86dc-0e324fb9be5b', '3d0311e3-ea7f-4d36-af77-1a06f96b70ee'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:00 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Delete snapshot completed successfully. Jul 05 02:45:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1d8fef1-c435-4b19-aab6-b74a2bbcecfa tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-47da6d7b-ac69-4d17-9181-d44fa7321d86-delete_snapshot" released by "delete_snapshot" :: held 5.928s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:00 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 1G" returned: 0 in 1.116s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eab7355-d961-4f9f-b140-930f9331b570 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:00 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eab7355-d961-4f9f-b140-930f9331b570 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 Jul 05 02:45:00 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:01 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eab7355-d961-4f9f-b140-930f9331b570 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1" returned: 0 in 0.935s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:01 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 is being set with open permissions: ugo+rw Jul 05 02:45:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:01 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 Jul 05 02:45:01 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:02 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1" returned: 0 in 0.737s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:02 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.info Jul 05 02:45:02 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:03 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.info" returned: 0 in 0.718s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:03 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.info is being set with open permissions: ugo+rw Jul 05 02:45:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:03 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.info Jul 05 02:45:03 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:03 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.info" returned: 0 in 0.723s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.817s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.565s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] Creating offline snapshot 034c0608-5075-4db8-b9eb-72353a051760 of volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:45:03 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[004f86cc-cd7f-4168-a373-d4def8613652]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-135a1ed3-dc86-45d7-b3d6-b162fa35aa8c tempest-VolumesDeleteCascade-1503406792 None] Create snapshot completed successfully Jul 05 02:45:04 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:45:04 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:04 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 1.107s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:05 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 1G Jul 05 02:45:05 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:45:05 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:45:05 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Flow 'volume_create_manager' (6fddf36f-401d-4b90-befc-acb33094a10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bb4a34-d5a6-4c86-a45e-07587314d84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bb4a34-d5a6-4c86-a45e-07587314d84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-599476225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a86f05-f907-4349-b9cb-b4c652fee5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5931be72a1f42e29ac29be8dfc3fd11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3cf8f40d-442a-4431-8ada-c16986ece9c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:05Z,use_quota=True,user_id='67c02eb3a30c485b978d26760dded913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5357a95-82bb-47c4-ac7f-1f18ce4c94c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5357a95-82bb-47c4-ac7f-1f18ce4c94c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e2e519-b42b-4459-86ae-2bd02f1b3aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e2e519-b42b-4459-86ae-2bd02f1b3aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2a86f05-f907-4349-b9cb-b4c652fee5c0', 'volume_name': 'volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0', 'volume_size': 1, 'snapshot_id': '3cf8f40d-442a-4431-8ada-c16986ece9c1'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d65266-2ab1-4e72-b5b3-174972d0900c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d65266-2ab1-4e72-b5b3-174972d0900c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8b5de1-1947-4a18-b87b-1475ec7ee614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:05 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Volume c2a86f05-f907-4349-b9cb-b4c652fee5c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0', 'volume_size': 1, 'snapshot_id': '3cf8f40d-442a-4431-8ada-c16986ece9c1'} Jul 05 02:45:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:06 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 1G" returned: 0 in 1.246s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:06 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.058s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:45:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:45:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:45:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:45:06 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 Jul 05 02:45:06 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:07 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760" returned: 0 in 0.813s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:07 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 is being set with open permissions: ugo+rw Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:07 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 Jul 05 02:45:07 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:07 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760" returned: 0 in 0.741s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.037s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.413s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-3cf8f40d-442a-4431-8ada-c16986ece9c1-c2a86f05-f907-4349-b9cb-b4c652fee5c0" by "_create_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-3cf8f40d-442a-4431-8ada-c16986ece9c1-c2a86f05-f907-4349-b9cb-b4c652fee5c0" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Creating volume c2a86f05-f907-4349-b9cb-b4c652fee5c0 from snapshot 3cf8f40d-442a-4431-8ada-c16986ece9c1 {{(pid=86671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-c2a86f05-f907-4349-b9cb-b4c652fee5c0" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-72ad3b5d-8357-4a25-94f4-5315f68ff71a tempest-SnapshotsActionsTest-38370347 None] Create snapshot completed successfully Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-c2a86f05-f907-4349-b9cb-b4c652fee5c0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] snapshot: 3cf8f40d-442a-4431-8ada-c16986ece9c1, volume: c2a86f05-f907-4349-b9cb-b4c652fee5c0, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21c5890-ad36-4dbb-9129-90bdcc6e2aa4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:08 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 Jul 05 02:45:08 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-034c0608-5075-4db8-b9eb-72353a051760-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-034c0608-5075-4db8-b9eb-72353a051760-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-quobyte-034c0608-5075-4db8-b9eb-72353a051760" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-034c0608-5075-4db8-b9eb-72353a051760" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Deleting offline snapshot 034c0608-5075-4db8-b9eb-72353a051760 of volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] snapshot_file for this snap is: volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a6dd7b-9816-4dec-bc36-fcd9d91b02b7]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:08 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1" returned: 0 in 1.037s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eab7355-d961-4f9f-b140-930f9331b570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebac0ade-0979-40ca-ac0a-c4d740e660ba]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:09 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 Jul 05 02:45:09 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:09 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 Jul 05 02:45:09 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:09 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760" returned: 0 in 0.797s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:09 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[95902d7f-21e0-4b40-a145-034e17965570]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:09 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570" returned: 0 in 0.795s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:09 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:45:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:09 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 Jul 05 02:45:09 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:09 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:45:09 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:10 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 0.972s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:10 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 Jul 05 02:45:10 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:13 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760" returned: 0 in 2.540s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:13 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760 Jul 05 02:45:13 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:14 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.034c0608-5075-4db8-b9eb-72353a051760" returned: 0 in 1.735s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-034c0608-5075-4db8-b9eb-72353a051760" released by "_delete_snapshot" :: held 6.240s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" released by "delete_snapshot" :: held 6.301s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:15 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Created reservations ['9eabf25a-58a9-4663-95a8-01d76ae3651a', '6efd7856-572d-4ce2-aeab-7af1373cffa2', '2eafb458-fcf3-4007-a596-78ab6f36b89f', 'ff1b6fe1-a73a-4bf6-b866-b990ea470efd'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:15 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Delete snapshot completed successfully. Jul 05 02:45:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-abb6f2f5-cfb3-4949-ae09-c2ccca96c462 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-034c0608-5075-4db8-b9eb-72353a051760-delete_snapshot" released by "delete_snapshot" :: held 6.811s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:16 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0" returned: 0 in 6.699s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:16 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f1f5b4-9cb1-4715-bbf8-29284bc444c2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:16 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 Jul 05 02:45:16 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:16 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=98,cinder:INSERT=30,cinder:UPDATE=99,cinder:DELETE=8 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:45:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:17 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570" returned: 0 in 1.329s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:17 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:45:17 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Converted 1024.00 MB image at 152.83 MB/s Jul 05 02:45:17 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 is being set with open permissions: ugo+rw Jul 05 02:45:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:17 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 Jul 05 02:45:17 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:18 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0" returned: 0 in 0.682s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-c2a86f05-f907-4349-b9cb-b4c652fee5c0" released by "_copy_volume_from_snapshot" :: held 10.644s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-3cf8f40d-442a-4431-8ada-c16986ece9c1-c2a86f05-f907-4349-b9cb-b4c652fee5c0" released by "_create_volume_from_snapshot" :: held 10.684s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.714s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.524s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] Creating offline snapshot 117b95e2-662d-4be4-b445-32dc3277c5ad of volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8b5de1-1947-4a18-b87b-1475ec7ee614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0', 'volume_size': 1, 'snapshot_id': '3cf8f40d-442a-4431-8ada-c16986ece9c1'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac3ead7-8440-4dd1-9ff1-0d88e81f96ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d45709-ca09-49ef-82e0-b95bdb385793]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:18 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Volume volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 (c2a86f05-f907-4349-b9cb-b4c652fee5c0): created successfully Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac3ead7-8440-4dd1-9ff1-0d88e81f96ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Flow 'volume_create_manager' (6fddf36f-401d-4b90-befc-acb33094a10c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-df72f38e-53ba-4f79-b4fc-72e06bae89f2 tempest-VolumesDeleteCascade-1503406792 None] Created volume successfully. Jul 05 02:45:18 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:45:18 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Flow 'volume_create_manager' (9031d5cf-1e7d-4c33-8d63-194116be6a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ae74e0-859f-4ecd-bdbc-a8d5d67db51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ae74e0-859f-4ecd-bdbc-a8d5d67db51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1641150616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a0877a49814ac7a36de7852ef0cb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:19Z,use_quota=True,user_id='54263e315d36407197a20e0ee6d70293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63be5f6c-f4e7-44f0-9af3-31076d50bc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63be5f6c-f4e7-44f0-9af3-31076d50bc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f85a41-f4ad-494e-989a-1884cddb0374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f85a41-f4ad-494e-989a-1884cddb0374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e', 'volume_name': 'volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac90620-3514-4af3-b256-413a2aa38471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac90620-3514-4af3-b256-413a2aa38471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d232bf43-5e16-47a1-8311-993c720584bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:18 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Volume 0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e', 'volume_size': 1} Jul 05 02:45:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:19 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 0.801s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:19 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad 1G Jul 05 02:45:19 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-0eab7355-d961-4f9f-b140-930f9331b570-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-0eab7355-d961-4f9f-b140-930f9331b570-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Performing cascade delete. {{(pid=86671) delete_volume /opt/stack/cinder/cinder/volume/manager.py:997}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-3cf8f40d-442a-4431-8ada-c16986ece9c1-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-3cf8f40d-442a-4431-8ada-c16986ece9c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-0eab7355-d961-4f9f-b140-930f9331b570" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-0eab7355-d961-4f9f-b140-930f9331b570" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-3cf8f40d-442a-4431-8ada-c16986ece9c1" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-3cf8f40d-442a-4431-8ada-c16986ece9c1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Deleting offline snapshot 3cf8f40d-442a-4431-8ada-c16986ece9c1 of volume 0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] snapshot_file for this snap is: volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2321aa-2ac5-42df-85fc-7103758c680c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:20 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 Jul 05 02:45:20 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:20 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad 1G" returned: 0 in 0.927s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:20 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad Jul 05 02:45:20 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:20 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1" returned: 0 in 0.857s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eab7355-d961-4f9f-b140-930f9331b570(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:20 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd75e507-4861-40b8-86bf-c2b1c8eb8481]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:20 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 Jul 05 02:45:20 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:21 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad" returned: 0 in 0.814s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:21 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad is being set with open permissions: ugo+rw Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:21 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad Jul 05 02:45:21 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:21 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570" returned: 0 in 0.855s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:21 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 Jul 05 02:45:21 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:21 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad" returned: 0 in 0.678s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.077s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1641150616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a0877a49814ac7a36de7852ef0cb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:19Z,use_quota=True,user_id='54263e315d36407197a20e0ee6d70293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Creating volume 0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:45:21 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:45:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:21 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e 1073741824 Jul 05 02:45:21 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ab17bb43-098d-4aea-b0ce-d92c14cbe0eb tempest-SnapshotsActionsTest-38370347 None] Create snapshot completed successfully Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-117b95e2-662d-4be4-b445-32dc3277c5ad-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-117b95e2-662d-4be4-b445-32dc3277c5ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-quobyte-117b95e2-662d-4be4-b445-32dc3277c5ad" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-117b95e2-662d-4be4-b445-32dc3277c5ad" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Deleting offline snapshot 117b95e2-662d-4be4-b445-32dc3277c5ad of volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] snapshot_file for this snap is: volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[469a2c84-7a96-4a94-abf2-9fea8c497035]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:22 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1" returned: 0 in 1.049s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:22 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad Jul 05 02:45:22 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1 Jul 05 02:45:22 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:22 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:23 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e 1073741824" returned: 0 in 1.371s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:23 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e Jul 05 02:45:23 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:23 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570.3cf8f40d-442a-4431-8ada-c16986ece9c1" returned: 0 in 1.002s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-3cf8f40d-442a-4431-8ada-c16986ece9c1" released by "_delete_snapshot" :: held 3.883s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-0eab7355-d961-4f9f-b140-930f9331b570" released by "delete_snapshot" :: held 3.915s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:23 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad" returned: 0 in 1.173s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:23 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3975cc1e-fe91-408a-8622-e63f97255191]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:23 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Created reservations ['b3ba9834-3f6d-4ad1-8b9a-81f14efe62a7', '73675da4-6e5c-4727-99c8-39f5ba3cbe2c', '5934e88c-be07-4354-879e-024eb9e0bf85', '8e4269a8-f15f-4750-8888-733b4705a466'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:24 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:45:24 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Delete snapshot completed successfully. Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-3cf8f40d-442a-4431-8ada-c16986ece9c1-delete_snapshot" released by "delete_snapshot" :: held 4.318s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Snapshots deleted, issuing volume delete {{(pid=86671) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1012}} Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-0eab7355-d961-4f9f-b140-930f9331b570" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-0eab7355-d961-4f9f-b140-930f9331b570" acquired by "delete_volume" :: waited 0.050s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa77a033-371a-4509-8e45-dc2f9df0d095]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:24 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e" returned: 0 in 1.029s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] <== create_volume: return (2464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.467s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d232bf43-5e16-47a1-8311-993c720584bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352fe05c-a469-4614-a97e-76c73b56241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:24 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 Jul 05 02:45:24 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:24 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Volume volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e (0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e): created successfully Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352fe05c-a469-4614-a97e-76c73b56241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Flow 'volume_create_manager' (9031d5cf-1e7d-4c33-8d63-194116be6a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9a9249ea-7346-459f-94ce-bb2ddff6f2f2 tempest-AttachVolumeTestJSON-563296492 None] Created volume successfully. Jul 05 02:45:24 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 1.121s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:25 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad Jul 05 02:45:25 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:25 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570" returned: 0 in 1.037s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:25 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570 Jul 05 02:45:25 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:26 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad" returned: 0 in 1.080s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:26 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0eab7355-d961-4f9f-b140-930f9331b570" returned: 0 in 0.785s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-0eab7355-d961-4f9f-b140-930f9331b570" released by "delete_volume" :: held 1.923s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:26 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad Jul 05 02:45:26 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Created reservations ['fb0c2a11-60bc-4e93-88ba-2adf74004c53', 'dd5b1c9b-0656-4af9-bb15-facb76479dab', '7aaab816-9b8d-444f-b0ae-8bdf7cc667f2', 'a10973ba-20de-415c-8696-613392122327'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:26 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:45:26 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-c2a86f05-f907-4349-b9cb-b4c652fee5c0-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-c2a86f05-f907-4349-b9cb-b4c652fee5c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "cinder-quobyte-c2a86f05-f907-4349-b9cb-b4c652fee5c0" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-c2a86f05-f907-4349-b9cb-b4c652fee5c0" acquired by "delete_volume" :: waited 0.037s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac8e2d5-e540-46b4-8593-55e37d7b5538]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:27 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 Jul 05 02:45:27 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:27 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.117b95e2-662d-4be4-b445-32dc3277c5ad" returned: 0 in 0.959s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-117b95e2-662d-4be4-b445-32dc3277c5ad" released by "_delete_snapshot" :: held 4.489s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" released by "delete_snapshot" :: held 4.527s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:27 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Created reservations ['f10fd240-d7ee-4617-8a4c-5b3f3606bbf3', '44ff9108-b253-422e-9a2c-46376afcd809', '685e51d1-44a1-437e-a8a6-3bd835e44565', '048b0328-5da8-44c0-a9ee-b2876eaf09b6'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Delete snapshot completed successfully. Jul 05 02:45:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b924293-e11b-46a4-a785-31724dc477e3 tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-117b95e2-662d-4be4-b445-32dc3277c5ad-delete_snapshot" released by "delete_snapshot" :: held 4.731s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:27 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.083s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:27 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:45:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Deleted volume successfully. Jul 05 02:45:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e81b772-66d9-4cfd-932c-8449df8b2ed6 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-0eab7355-d961-4f9f-b140-930f9331b570-delete_volume" released by "delete_volume" :: held 7.707s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:27 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0" returned: 0 in 1.047s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:27 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0 Jul 05 02:45:27 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Flow 'volume_create_manager' (60b01647-62b7-478e-8084-db54124c8498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fde649a-e4e0-4371-821c-07cebaa63f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] Creating offline snapshot 6ebddd09-18a9-49b0-914c-b932b6ce5d02 of volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fde649a-e4e0-4371-821c-07cebaa63f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1653717435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4fbd0b-def2-47ec-b899-f0de1bb4a051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47022ff3f684afbb8607ed4eae4471f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:28Z,use_quota=True,user_id='c1e557e9e48d4bd9a188bd526379333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f440734b-1a62-461f-a223-d044cbea9f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f440734b-1a62-461f-a223-d044cbea9f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce7ca89-9586-484b-8ee8-caae8b836e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce7ca89-9586-484b-8ee8-caae8b836e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4fbd0b-def2-47ec-b899-f0de1bb4a051', 'volume_name': 'volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9acaace-ae5a-405f-99ec-d0b5c1b65f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9acaace-ae5a-405f-99ec-d0b5c1b65f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484706dd-3455-40f7-90cc-e6c5786df56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:28 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Volume 4a4fbd0b-def2-47ec-b899-f0de1bb4a051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051', 'volume_size': 1} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[57270516-79a4-4343-ba65-798c558c4b5b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-b97a057a-a288-4768-bba6-750d7b6262f0 req-e13bcc20-8684-475d-af37-a5e3f8980bdd tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:28 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c2a86f05-f907-4349-b9cb-b4c652fee5c0" returned: 0 in 0.751s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-quobyte-c2a86f05-f907-4349-b9cb-b4c652fee5c0" released by "delete_volume" :: held 1.867s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:28 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:45:28 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Created reservations ['080aa4b3-943b-43f5-b60a-2b5f4fcbf25d', 'a96e526f-37c8-4548-ae1d-1760be2f28e0', 'be80c2a0-0af7-439e-a67a-ffcb73eb7ca5', '2820c02e-41a6-4fcd-8303-b39eb56d174b'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:28 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:45:28 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:29 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 0.816s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:29 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 1G Jul 05 02:45:29 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:29 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.709s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:29 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:45:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Deleted volume successfully. Jul 05 02:45:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3aee3b49-f3a3-4712-a995-51793825f605 tempest-VolumesDeleteCascade-1503406792 None] Lock "cinder-c2a86f05-f907-4349-b9cb-b4c652fee5c0-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:30 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 1G" returned: 0 in 0.889s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:30 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 Jul 05 02:45:30 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:31 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02" returned: 0 in 0.719s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:31 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 is being set with open permissions: ugo+rw Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:31 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 Jul 05 02:45:31 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:31 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02" returned: 0 in 0.658s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.278s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.143s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1653717435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4fbd0b-def2-47ec-b899-f0de1bb4a051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47022ff3f684afbb8607ed4eae4471f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:28Z,use_quota=True,user_id='c1e557e9e48d4bd9a188bd526379333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Creating volume 4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:45:31 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:31 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 1073741824 Jul 05 02:45:31 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-141e31a4-c274-4642-993d-097b26d8006f tempest-SnapshotsActionsTest-38370347 None] Create snapshot completed successfully Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:45:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (3fde1de7-4fba-49be-9900-63700777f373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44c0438-8947-4db5-b155-9ca0652514f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44c0438-8947-4db5-b155-9ca0652514f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1422981289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6f395c-8292-4a3e-a9c0-34f21e27542e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:32Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e9bbdf-cd4d-4298-8e66-0f1e08b0cd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e9bbdf-cd4d-4298-8e66-0f1e08b0cd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464fd6e3-728f-4f42-8f92-56afda18f5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464fd6e3-728f-4f42-8f92-56afda18f5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6f395c-8292-4a3e-a9c0-34f21e27542e', 'volume_name': 'volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ad302f-699a-465e-acaa-28849d651f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ad302f-699a-465e-acaa-28849d651f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9819e9f6-11b1-4c9a-9824-e33c8329b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:32 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Volume 7c6f395c-8292-4a3e-a9c0-34f21e27542e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e', 'volume_size': 1} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:32 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 1073741824" returned: 0 in 0.846s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:32 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 Jul 05 02:45:32 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-6ebddd09-18a9-49b0-914c-b932b6ce5d02-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-6ebddd09-18a9-49b0-914c-b932b6ce5d02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Acquiring lock "cinder-quobyte-6ebddd09-18a9-49b0-914c-b932b6ce5d02" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-6ebddd09-18a9-49b0-914c-b932b6ce5d02" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Deleting offline snapshot 6ebddd09-18a9-49b0-914c-b932b6ce5d02 of volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] snapshot_file for this snap is: volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[678970d0-b594-4b92-8cde-c0a9cc8d73ed]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:33 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 Jul 05 02:45:33 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:33 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" returned: 0 in 0.671s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-b97a057a-a288-4768-bba6-750d7b6262f0 req-e13bcc20-8684-475d-af37-a5e3f8980bdd tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.670s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484706dd-3455-40f7-90cc-e6c5786df56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d023c1-2690-48ee-a5de-c54e134cd461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c186948-6b56-4a44-9562-bde47ef0aa1d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-b97a057a-a288-4768-bba6-750d7b6262f0 req-e13bcc20-8684-475d-af37-a5e3f8980bdd tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:33 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Volume volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 (4a4fbd0b-def2-47ec-b899-f0de1bb4a051): created successfully Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d023c1-2690-48ee-a5de-c54e134cd461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Flow 'volume_create_manager' (60b01647-62b7-478e-8084-db54124c8498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9bff824a-132e-44b0-9249-2e14b9bbd498 tempest-SnapshotDependencyTests-1543001073 None] Created volume successfully. Jul 05 02:45:33 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e Jul 05 02:45:33 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02" returned: 0 in 0.866s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:34 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[318dc109-f66c-4721-8954-0a7cd3f047cf]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:34 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-b97a057a-a288-4768-bba6-750d7b6262f0 req-e13bcc20-8684-475d-af37-a5e3f8980bdd tempest-AttachVolumeTestJSON-563296492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e" returned: 0 in 0.825s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-b97a057a-a288-4768-bba6-750d7b6262f0 req-e13bcc20-8684-475d-af37-a5e3f8980bdd tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.853s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.130s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1422981289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6f395c-8292-4a3e-a9c0-34f21e27542e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:32Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Creating volume 7c6f395c-8292-4a3e-a9c0-34f21e27542e {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:34 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:45:34 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:45:34 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:34 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e 1073741824 Jul 05 02:45:34 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-b97a057a-a288-4768-bba6-750d7b6262f0 req-e13bcc20-8684-475d-af37-a5e3f8980bdd tempest-AttachVolumeTestJSON-563296492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cdebec7-2c07-4996-a75b-158e2b7a914f', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:34 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-b97a057a-a288-4768-bba6-750d7b6262f0 req-e13bcc20-8684-475d-af37-a5e3f8980bdd tempest-AttachVolumeTestJSON-563296492 None] attachment_update completed successfully. Jul 05 02:45:34 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 0.818s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:34 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 Jul 05 02:45:34 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:35 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e 1073741824" returned: 0 in 0.919s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:35 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e Jul 05 02:45:35 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:35 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02" returned: 0 in 0.871s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:35 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02 Jul 05 02:45:35 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:35 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e" returned: 0 in 0.708s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.510s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Creating offline snapshot a5638284-b3da-4643-9a6e-3d550d475000 of volume 4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9819e9f6-11b1-4c9a-9824-e33c8329b234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7e9609-8aad-407d-8c1e-41d3c59e9d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd363475-30cd-4555-8715-26ca3779e114]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:35 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Volume volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e (7c6f395c-8292-4a3e-a9c0-34f21e27542e): created successfully Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7e9609-8aad-407d-8c1e-41d3c59e9d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (3fde1de7-4fba-49be-9900-63700777f373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-68327388-d350-4c60-a206-4402736b6030 tempest-VolumesGetTest-227949493 None] Created volume successfully. Jul 05 02:45:36 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 Jul 05 02:45:36 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:36 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.6ebddd09-18a9-49b0-914c-b932b6ce5d02" returned: 0 in 0.703s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-6ebddd09-18a9-49b0-914c-b932b6ce5d02" released by "_delete_snapshot" :: held 3.384s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" released by "delete_snapshot" :: held 3.411s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:36 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Created reservations ['634f1efd-f326-49d1-822f-4116b4dcea9a', '19d137ec-c1a6-41bc-8d22-217f18fd5d95', 'cd17c336-f30c-47f0-9962-25670beafd7a', 'e919db29-8a26-4c6c-afd6-797fd50b5503'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Delete snapshot completed successfully. Jul 05 02:45:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a7b6cda-305b-4c7a-8ce1-4f161da8003d tempest-SnapshotsActionsTest-1412095986 None] Lock "cinder-6ebddd09-18a9-49b0-914c-b932b6ce5d02-delete_snapshot" released by "delete_snapshot" :: held 3.625s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:36 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" returned: 0 in 0.864s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:36 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 1G Jul 05 02:45:36 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (dfed97ae-d085-4e6d-9cf6-895e304ed311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb04200d-c808-415a-9847-3f5778251d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb04200d-c808-415a-9847-3f5778251d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1889596735',display_name='tempest-VolumesGetTest-Volume-1247855385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0da4e15-dfcb-47ef-b299-d45a63ee9b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:37Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5587d0f7-0339-409a-b205-04272582f9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5587d0f7-0339-409a-b205-04272582f9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd3dd43-c19d-47e5-b01e-6b2b027d9e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd3dd43-c19d-47e5-b01e-6b2b027d9e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0da4e15-dfcb-47ef-b299-d45a63ee9b6b', 'volume_name': 'volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f66efe-e6b3-4304-999f-747c6ff153b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f66efe-e6b3-4304-999f-747c6ff153b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ee523f-d3d7-4e08-b233-caa3ea528bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:37 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Volume c0da4e15-dfcb-47ef-b299-d45a63ee9b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b', 'volume_size': 1} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:37 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 1G" returned: 0 in 0.876s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:37 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 Jul 05 02:45:37 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "cinder-d1182977-d58c-46b0-ae86-ec8beefe6870-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Lock "cinder-d1182977-d58c-46b0-ae86-ec8beefe6870-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "cinder-quobyte-d1182977-d58c-46b0-ae86-ec8beefe6870" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Lock "cinder-quobyte-d1182977-d58c-46b0-ae86-ec8beefe6870" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Deleting offline snapshot d1182977-d58c-46b0-ae86-ec8beefe6870 of volume 934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] snapshot_file for this snap is: volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e835e477-53bb-4839-a01b-0f58521166e1]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:38 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:45:38 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:38 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000" returned: 0 in 0.776s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:38 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 is being set with open permissions: ugo+rw Jul 05 02:45:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:38 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 Jul 05 02:45:38 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:38 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 0.801s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-934c26db-c2d3-4904-8700-ced315903273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:38 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee50f38-760e-4718-b24f-f2ff36cecc87]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:38 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 Jul 05 02:45:38 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:39 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000" returned: 0 in 0.666s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:39 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.info Jul 05 02:45:39 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:39 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273" returned: 0 in 0.820s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:39 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:45:39 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:39 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.info" returned: 0 in 0.692s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:39 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.info is being set with open permissions: ugo+rw Jul 05 02:45:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:39 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.info Jul 05 02:45:39 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Flow 'volume_create_manager' (440ea428-a17b-4a17-aae0-76f9bd364e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326df673-5cff-46a0-a88d-1dc3f0ce4c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (326df673-5cff-46a0-a88d-1dc3f0ce4c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-749304791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2c94a2-8971-4138-ac0c-43507adea791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a0877a49814ac7a36de7852ef0cb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:40Z,use_quota=True,user_id='54263e315d36407197a20e0ee6d70293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e6e02a-282f-4059-8bef-76859088214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e6e02a-282f-4059-8bef-76859088214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651dbb4a-2be7-40cf-9c50-60afff4eb8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651dbb4a-2be7-40cf-9c50-60afff4eb8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b2c94a2-8971-4138-ac0c-43507adea791', 'volume_name': 'volume-1b2c94a2-8971-4138-ac0c-43507adea791', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a59f2aa-6304-4d16-8f21-5664f66e42fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a59f2aa-6304-4d16-8f21-5664f66e42fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bcc92b-4fd1-4909-bb59-6f7292d0a0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:40 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Volume 1b2c94a2-8971-4138-ac0c-43507adea791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b2c94a2-8971-4138-ac0c-43507adea791', 'volume_size': 1} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:40 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 0.748s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:40 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870 Jul 05 02:45:40 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:40 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.info" returned: 0 in 0.696s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.675s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.451s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1889596735',display_name='tempest-VolumesGetTest-Volume-1247855385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0da4e15-dfcb-47ef-b299-d45a63ee9b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:37Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Creating volume c0da4e15-dfcb-47ef-b299-d45a63ee9b6b {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:45:40 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:45:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:40 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b 1073741824 Jul 05 02:45:40 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f2d05dda-29ea-437e-a89a-c8ddbc73c94f tempest-SnapshotDependencyTests-1543001073 None] Create snapshot completed successfully Jul 05 02:45:41 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273.d1182977-d58c-46b0-ae86-ec8beefe6870" returned: 0 in 0.677s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Lock "cinder-quobyte-d1182977-d58c-46b0-ae86-ec8beefe6870" released by "_delete_snapshot" :: held 3.163s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" released by "delete_snapshot" :: held 3.188s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:41 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Created reservations ['7941e554-ca5d-4844-b85d-b9b96a1c49f0', 'a67f79ca-3675-42cc-b3d1-aaab535970ca', 'a8fe78e0-ec9a-4f1a-bad7-1efc253344a8', '7f444204-26ca-4825-94aa-6cf786388f34'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:41 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Delete snapshot completed successfully. Jul 05 02:45:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6c8bb953-3d3f-4d89-9b37-a3d97048d15e tempest-SnapshotsActionsTest-38370347 None] Lock "cinder-d1182977-d58c-46b0-ae86-ec8beefe6870-delete_snapshot" released by "delete_snapshot" :: held 3.344s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:41 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b 1073741824" returned: 0 in 0.868s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:41 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b Jul 05 02:45:41 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:42 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b" returned: 0 in 0.693s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.057s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-749304791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2c94a2-8971-4138-ac0c-43507adea791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a0877a49814ac7a36de7852ef0cb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:40Z,use_quota=True,user_id='54263e315d36407197a20e0ee6d70293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Creating volume 1b2c94a2-8971-4138-ac0c-43507adea791 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:45:42 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "cinder-934c26db-c2d3-4904-8700-ced315903273-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ee523f-d3d7-4e08-b233-caa3ea528bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:42 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 1073741824 Jul 05 02:45:42 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3958d72-aa25-4f43-a0be-9640ec4563f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Lock "cinder-934c26db-c2d3-4904-8700-ced315903273-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:42 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Volume volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b (c0da4e15-dfcb-47ef-b299-d45a63ee9b6b): created successfully Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3958d72-aa25-4f43-a0be-9640ec4563f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (dfed97ae-d085-4e6d-9cf6-895e304ed311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:45:42 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-df11a315-1e46-4b2e-a814-2527f88546dd tempest-VolumesGetTest-227949493 None] Created volume successfully. Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Flow 'volume_create_manager' (161cc6d0-bca4-4c5c-81de-56ef762c3dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b54574-b725-401b-b902-d8d9a02a1d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b54574-b725-401b-b902-d8d9a02a1d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a344bd-a9c4-466a-85a3-df67b4697d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47022ff3f684afbb8607ed4eae4471f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a5638284-b3da-4643-9a6e-3d550d475000,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:42Z,use_quota=True,user_id='c1e557e9e48d4bd9a188bd526379333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98222fd-5093-431f-99ec-50213c879dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98222fd-5093-431f-99ec-50213c879dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa4fb65-b26e-4b21-90da-cc6f19bc6cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa4fb65-b26e-4b21-90da-cc6f19bc6cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67a344bd-a9c4-466a-85a3-df67b4697d6f', 'volume_name': 'volume-67a344bd-a9c4-466a-85a3-df67b4697d6f', 'volume_size': 1, 'snapshot_id': 'a5638284-b3da-4643-9a6e-3d550d475000'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d79e4c-fd1e-4e8c-9ecf-770e42cd08f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d79e4c-fd1e-4e8c-9ecf-770e42cd08f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f37e4fc-7843-4f9e-bec9-9765a31ee2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:42 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Volume 67a344bd-a9c4-466a-85a3-df67b4697d6f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67a344bd-a9c4-466a-85a3-df67b4697d6f', 'volume_size': 1, 'snapshot_id': 'a5638284-b3da-4643-9a6e-3d550d475000'} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b68aa93-5b7f-4ac3-8bf1-47d2c1bc5e80]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:42 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 Jul 05 02:45:42 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:43 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 1073741824" returned: 0 in 0.889s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:43 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 Jul 05 02:45:43 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:43 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273" returned: 0 in 0.804s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:43 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273 Jul 05 02:45:43 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Lock "cinder-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-quobyte-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[65743d21-e7f8-4f8d-94a9-13b16b30f865]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:43 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791" returned: 0 in 0.674s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.325s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "cinder-quobyte-a5638284-b3da-4643-9a6e-3d550d475000-67a344bd-a9c4-466a-85a3-df67b4697d6f" by "_create_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:43 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b Jul 05 02:45:43 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bcc92b-4fd1-4909-bb59-6f7292d0a0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2c94a2-8971-4138-ac0c-43507adea791', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98c0c1d-7913-4adf-82c7-af15bc57a26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-a5638284-b3da-4643-9a6e-3d550d475000-67a344bd-a9c4-466a-85a3-df67b4697d6f" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Creating volume 67a344bd-a9c4-466a-85a3-df67b4697d6f from snapshot a5638284-b3da-4643-9a6e-3d550d475000 {{(pid=86671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "cinder-quobyte-67a344bd-a9c4-466a-85a3-df67b4697d6f" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:43 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Volume volume-1b2c94a2-8971-4138-ac0c-43507adea791 (1b2c94a2-8971-4138-ac0c-43507adea791): created successfully Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98c0c1d-7913-4adf-82c7-af15bc57a26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Flow 'volume_create_manager' (440ea428-a17b-4a17-aae0-76f9bd364e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-67a344bd-a9c4-466a-85a3-df67b4697d6f" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] snapshot: a5638284-b3da-4643-9a6e-3d550d475000, volume: 67a344bd-a9c4-466a-85a3-df67b4697d6f, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:45:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-48ddc8f8-0eb8-4850-8131-093e81e73be1 tempest-AttachVolumeTestJSON-563296492 None] Created volume successfully. Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f55577e-c529-4cb7-98e7-c9f1b1cf0b8f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:44 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-934c26db-c2d3-4904-8700-ced315903273" returned: 0 in 0.709s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Lock "cinder-quobyte-934c26db-c2d3-4904-8700-ced315903273" released by "delete_volume" :: held 1.572s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:44 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 Jul 05 02:45:44 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Created reservations ['16488ca2-9e98-4bb1-a215-b0202fb9caa1', '396a95bb-4a9f-4cdf-ba4c-aea5ee877d68', '1eac7757-9891-4aa4-b306-bce451d3154b', 'd81c9bec-4610-4bc6-aced-b136e48d324a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:44 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:45:44 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:44 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b" returned: 0 in 0.871s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:44 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b Jul 05 02:45:44 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:44 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000" returned: 0 in 0.981s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cba7d8e-5168-4159-8aa4-7038ba8fe3a8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:44 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.817s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:45:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Deleted volume successfully. Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ba6e0d28-d313-44a8-bdd5-b63dc43ddba4 tempest-SnapshotsActionsTest-38370347 None] Lock "cinder-934c26db-c2d3-4904-8700-ced315903273-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:45 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 Jul 05 02:45:45 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:45 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b" returned: 0 in 0.791s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b" released by "delete_volume" :: held 1.711s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=95,cinder:INSERT=25,cinder:UPDATE=103,cinder:DELETE=8 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Created reservations ['20da6ecd-406b-4602-854e-2e738795a5ff', 'aa26a6c8-1301-4085-bca4-3508fbf02192', '2be026d3-9e98-4262-8937-f620ca8f4e0e', '7a20392c-6109-4570-b0d0-f2099d9df29c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:45 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:45:45 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:45 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" returned: 0 in 0.892s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:45 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f Jul 05 02:45:45 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-7c6f395c-8292-4a3e-a9c0-34f21e27542e-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Lock "cinder-7c6f395c-8292-4a3e-a9c0-34f21e27542e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-quobyte-7c6f395c-8292-4a3e-a9c0-34f21e27542e" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-7c6f395c-8292-4a3e-a9c0-34f21e27542e" acquired by "delete_volume" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd707695-cb2a-42cf-bdd2-8a88826fe431]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:46 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e Jul 05 02:45:46 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:46 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.958s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:46 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:45:46 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Deleted volume successfully. Jul 05 02:45:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-33f5f4da-3484-436c-915e-a102b3036b49 tempest-VolumesGetTest-227949493 None] Lock "cinder-c0da4e15-dfcb-47ef-b299-d45a63ee9b6b-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:47 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e" returned: 0 in 1.060s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:47 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e Jul 05 02:45:47 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-5d008a10-eac2-446f-9e59-308fcfdbe402 req-6428912b-afab-4e65-9c07-5548cfe512b4 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:48 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7c6f395c-8292-4a3e-a9c0-34f21e27542e" returned: 0 in 1.551s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:48 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-7c6f395c-8292-4a3e-a9c0-34f21e27542e" released by "delete_volume" :: held 2.697s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:48 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Created reservations ['cc8e5514-2b64-4cea-a158-2c0bd73beebe', '3be13852-fb2a-4168-8c02-052458f5148e', '11ba8968-21de-4531-adfd-6cf65532a995', '49afe169-b971-43c5-9d80-674904cef4a7'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:49 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:45:49 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:50 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.906s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:50 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:45:50 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:45:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (08f848da-ce7c-4713-b829-1a94d6a43834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48617ae-a63f-4412-871d-572f38dee228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Deleted volume successfully. Jul 05 02:45:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48617ae-a63f-4412-871d-572f38dee228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1100285692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623eb2f0-bb92-493d-abc8-d44270b6b52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:51Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43c9d4b-13bb-474c-a4fc-6bd24f18b451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43c9d4b-13bb-474c-a4fc-6bd24f18b451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc6edf7-91c6-4079-816c-5d9363c28083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc6edf7-91c6-4079-816c-5d9363c28083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623eb2f0-bb92-493d-abc8-d44270b6b52e', 'volume_name': 'volume-623eb2f0-bb92-493d-abc8-d44270b6b52e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbfc600-3c65-42b8-b3b2-67ef8e2e749d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbfc600-3c65-42b8-b3b2-67ef8e2e749d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e338088a-341f-4866-95f5-77469bc010ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:51 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Volume 623eb2f0-bb92-493d-abc8-d44270b6b52e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623eb2f0-bb92-493d-abc8-d44270b6b52e', 'volume_size': 1} Jul 05 02:45:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3df689da-4326-41a0-a200-49e2b5a8a129 tempest-VolumesGetTest-227949493 None] Lock "cinder-7c6f395c-8292-4a3e-a9c0-34f21e27542e-delete_volume" released by "delete_volume" :: held 5.250s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:52 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f" returned: 0 in 6.359s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:52 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff6408e-5e8e-41e0-aad0-ad153e342190]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:52 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 Jul 05 02:45:52 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:53 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" returned: 0 in 0.930s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:45:53 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Converted 1024.00 MB image at 160.98 MB/s Jul 05 02:45:53 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f is being set with open permissions: ugo+rw Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:53 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f Jul 05 02:45:53 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:53 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f" returned: 0 in 0.657s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-67a344bd-a9c4-466a-85a3-df67b4697d6f" released by "_copy_volume_from_snapshot" :: held 9.953s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-a5638284-b3da-4643-9a6e-3d550d475000-67a344bd-a9c4-466a-85a3-df67b4697d6f" released by "_create_volume_from_snapshot" :: held 10.008s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.047s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-5d008a10-eac2-446f-9e59-308fcfdbe402 req-6428912b-afab-4e65-9c07-5548cfe512b4 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.759s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9504cf0-e237-4e9c-b320-e67bb9084d56]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-5d008a10-eac2-446f-9e59-308fcfdbe402 req-6428912b-afab-4e65-9c07-5548cfe512b4 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f37e4fc-7843-4f9e-bec9-9765a31ee2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a344bd-a9c4-466a-85a3-df67b4697d6f', 'volume_size': 1, 'snapshot_id': 'a5638284-b3da-4643-9a6e-3d550d475000'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61ace8f-2b2f-4fb2-8e2e-a8604757842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:53 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Volume volume-67a344bd-a9c4-466a-85a3-df67b4697d6f (67a344bd-a9c4-466a-85a3-df67b4697d6f): created successfully Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61ace8f-2b2f-4fb2-8e2e-a8604757842c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Flow 'volume_create_manager' (161cc6d0-bca4-4c5c-81de-56ef762c3dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:53 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-91a64024-a366-4b8f-bfe8-9fbf8e8cbe81 tempest-SnapshotDependencyTests-1543001073 None] Created volume successfully. Jul 05 02:45:54 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 Jul 05 02:45:54 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:54 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-5d008a10-eac2-446f-9e59-308fcfdbe402 req-6428912b-afab-4e65-9c07-5548cfe512b4 tempest-AttachVolumeTestJSON-563296492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791" returned: 0 in 0.845s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-5d008a10-eac2-446f-9e59-308fcfdbe402 req-6428912b-afab-4e65-9c07-5548cfe512b4 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.868s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.526s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1100285692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623eb2f0-bb92-493d-abc8-d44270b6b52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:51Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Creating volume 623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:45:54 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:54 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e 1073741824 Jul 05 02:45:54 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-5d008a10-eac2-446f-9e59-308fcfdbe402 req-6428912b-afab-4e65-9c07-5548cfe512b4 tempest-AttachVolumeTestJSON-563296492 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-1b2c94a2-8971-4138-ac0c-43507adea791', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6e38e5f-c4c8-40d4-8b7f-517a688d8045', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:45:54 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-5d008a10-eac2-446f-9e59-308fcfdbe402 req-6428912b-afab-4e65-9c07-5548cfe512b4 tempest-AttachVolumeTestJSON-563296492 None] attachment_update completed successfully. Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "cinder-a5638284-b3da-4643-9a6e-3d550d475000-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-a5638284-b3da-4643-9a6e-3d550d475000-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "cinder-quobyte-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "cinder-quobyte-a5638284-b3da-4643-9a6e-3d550d475000" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-a5638284-b3da-4643-9a6e-3d550d475000" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Deleting offline snapshot a5638284-b3da-4643-9a6e-3d550d475000 of volume 4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] snapshot_file for this snap is: volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb255be2-258d-4431-9efc-6e44d8002126]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:55 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 Jul 05 02:45:55 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:55 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e 1073741824" returned: 0 in 1.050s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:55 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e Jul 05 02:45:55 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:56 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000" returned: 0 in 1.011s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4b77d4-5b96-4a53-84e9-56da44ade864]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:56 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 Jul 05 02:45:56 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:56 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e" returned: 0 in 0.826s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e338088a-341f-4866-95f5-77469bc010ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623eb2f0-bb92-493d-abc8-d44270b6b52e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f32659-9708-4fb7-ad12-83bb6b7e0bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:56 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Volume volume-623eb2f0-bb92-493d-abc8-d44270b6b52e (623eb2f0-bb92-493d-abc8-d44270b6b52e): created successfully Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f32659-9708-4fb7-ad12-83bb6b7e0bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (08f848da-ce7c-4713-b829-1a94d6a43834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f99216aa-f019-4dc8-9651-7b9a6ee064f6 tempest-VolumesGetTest-227949493 None] Created volume successfully. Jul 05 02:45:57 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" returned: 0 in 0.823s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:57 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 Jul 05 02:45:57 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:57 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:45:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (d8764cfd-55c5-4588-8db5-81bfe44f34dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:45:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ea6cf-566f-4703-bbee-4fbbd731af72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ea6cf-566f-4703-bbee-4fbbd731af72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-622444958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda4358b-c7f7-4137-ac38-7cf4d033b5b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=623eb2f0-bb92-493d-abc8-d44270b6b52e,status='creating',terminated_at=None,updated_at=2026-07-05T00:45:58Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66488fb4-1762-489e-b91c-df626f24e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66488fb4-1762-489e-b91c-df626f24e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef8d725-3554-4818-8928-ae919482bc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef8d725-3554-4818-8928-ae919482bc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cda4358b-c7f7-4137-ac38-7cf4d033b5b0', 'volume_name': 'volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0', 'volume_size': 1, 'source_volid': '623eb2f0-bb92-493d-abc8-d44270b6b52e', 'source_volstatus': 'available'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1342e419-d0e9-46a9-a3c8-976eb165d661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1342e419-d0e9-46a9-a3c8-976eb165d661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2904668-ba57-499c-9fd5-f1d94d5c45bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:45:58 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Volume cda4358b-c7f7-4137-ac38-7cf4d033b5b0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0', 'volume_size': 1, 'source_volid': '623eb2f0-bb92-493d-abc8-d44270b6b52e', 'source_volstatus': 'available'} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:45:58 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Cloning volume 623eb2f0-bb92-493d-abc8-d44270b6b52e to volume cda4358b-c7f7-4137-ac38-7cf4d033b5b0 Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Creating offline snapshot ee4596e4-982b-4ab9-884c-62c7ee0d0e58 of volume 623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:45:58 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d4f38e-30eb-4c88-bb5a-6f87d89b543e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000" returned: 0 in 0.922s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:58 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000 Jul 05 02:45:58 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:58 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e Jul 05 02:45:58 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:59 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051.a5638284-b3da-4643-9a6e-3d550d475000" returned: 0 in 0.903s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-a5638284-b3da-4643-9a6e-3d550d475000" released by "_delete_snapshot" :: held 3.823s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" released by "delete_snapshot" :: held 3.879s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:59 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e" returned: 0 in 1.053s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:59 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 1G Jul 05 02:45:59 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Created reservations ['71e50b93-7a03-4505-a00a-b404ed245560', 'ed1163dd-c710-493a-9444-c29615eb8fda', '768f3fa6-ec96-46a5-b944-0885312745f4', 'e36deac5-5eba-45dc-8f4b-b486c233562e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:45:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Delete snapshot completed successfully. Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-135209cf-ba81-4e19-9964-76f7094bc3a8 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-a5638284-b3da-4643-9a6e-3d550d475000-delete_snapshot" released by "delete_snapshot" :: held 4.112s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "cinder-4a4fbd0b-def2-47ec-b899-f0de1bb4a051-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-4a4fbd0b-def2-47ec-b899-f0de1bb4a051-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "cinder-quobyte-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e553c599-b94d-437f-a208-4263292ac18e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:45:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:45:59 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 Jul 05 02:45:59 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:00 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 1G" returned: 0 in 0.950s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623eb2f0-bb92-493d-abc8-d44270b6b52e -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:00 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623eb2f0-bb92-493d-abc8-d44270b6b52e -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 Jul 05 02:46:00 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:00 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" returned: 0 in 0.891s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:00 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051 Jul 05 02:46:00 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:00 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623eb2f0-bb92-493d-abc8-d44270b6b52e -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58" returned: 0 in 0.825s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:00 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 is being set with open permissions: ugo+rw Jul 05 02:46:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:01 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 Jul 05 02:46:01 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Flow 'volume_create_manager' (2ced5b12-1cd3-48a7-9d7a-9cbc950c2f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2718d07-cdc2-4c0a-bade-39979e5f9624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2718d07-cdc2-4c0a-bade-39979e5f9624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1268763411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b38014-53af-4a64-b4e6-b7e75d894cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322ffa2204948a1a76240f661677c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:01Z,use_quota=True,user_id='302f3bb69c1647929c122847cb064604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b041d6-d4f7-4f0c-a369-ec4f83aad17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b041d6-d4f7-4f0c-a369-ec4f83aad17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc366d77-0f47-46e0-9e8e-6697a5437994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc366d77-0f47-46e0-9e8e-6697a5437994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b38014-53af-4a64-b4e6-b7e75d894cab', 'volume_name': 'volume-92b38014-53af-4a64-b4e6-b7e75d894cab', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4c16f7-518b-4cc7-908d-8dc9f1676fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4c16f7-518b-4cc7-908d-8dc9f1676fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94d77ae-39b9-4e77-a534-d47a4567867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:01 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Volume 92b38014-53af-4a64-b4e6-b7e75d894cab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b38014-53af-4a64-b4e6-b7e75d894cab', 'volume_size': 1} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:01 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-b670e610-7985-443e-936d-9d450aaae981 req-5411fd14-aa4d-4b7d-88d7-51536cb3566f tempest-AttachVolumeTestJSON-563296492 None] Terminate volume connection completed successfully. Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-b670e610-7985-443e-936d-9d450aaae981 req-5411fd14-aa4d-4b7d-88d7-51536cb3566f tempest-AttachVolumeTestJSON-563296492 None] Deleting attachment 4cdebec7-2c07-4996-a75b-158e2b7a914f. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:46:01 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" returned: 0 in 0.800s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-4a4fbd0b-def2-47ec-b899-f0de1bb4a051" released by "delete_volume" :: held 1.775s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Created reservations ['a6446fd8-656a-4bb7-9dd2-33ab4109c153', '02629b38-056e-43cd-b210-cceea4d55f62', 'f906035e-c866-4196-b7a8-a57c416cbbb0', '709a0855-2230-4a9a-92ab-4b2eea8922f2'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:01 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:01 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:01 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58" returned: 0 in 0.742s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:01 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.info Jul 05 02:46:01 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "cinder-67a344bd-a9c4-466a-85a3-df67b4697d6f-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-67a344bd-a9c4-466a-85a3-df67b4697d6f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "cinder-quobyte-67a344bd-a9c4-466a-85a3-df67b4697d6f" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-67a344bd-a9c4-466a-85a3-df67b4697d6f" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3ed329-93d7-42bb-b7eb-73cc902ff8f1]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:02 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f Jul 05 02:46:02 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:02 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.828s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:02 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:02 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Deleted volume successfully. Jul 05 02:46:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f3c8c1b7-4abe-4c56-aeee-7db94e047f0b tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-4a4fbd0b-def2-47ec-b899-f0de1bb4a051-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:02 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.info" returned: 0 in 0.827s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:02 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.info is being set with open permissions: ugo+rw Jul 05 02:46:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:02 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.info Jul 05 02:46:02 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:02 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f" returned: 0 in 0.926s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:02 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f Jul 05 02:46:02 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:03 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.info" returned: 0 in 0.661s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-quobyte-cda4358b-c7f7-4137-ac38-7cf4d033b5b0" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-cda4358b-c7f7-4137-ac38-7cf4d033b5b0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] snapshot: ee4596e4-982b-4ab9-884c-62c7ee0d0e58, volume: cda4358b-c7f7-4137-ac38-7cf4d033b5b0, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c12fc0-8819-4ccb-8a44-23886d5aa27f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:03 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 Jul 05 02:46:03 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:03 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-67a344bd-a9c4-466a-85a3-df67b4697d6f" returned: 0 in 0.673s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-quobyte-67a344bd-a9c4-466a-85a3-df67b4697d6f" released by "delete_volume" :: held 1.670s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Created reservations ['1533eb17-acb9-4217-8538-b1e3b67bd351', 'c5282ac4-8212-4a14-a6eb-d83aa447aca1', '6772ebfa-30e6-4e1e-97ab-aeae5bab6af8', '02ebf075-01c9-4cc4-a23d-6996a93dfa37'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:03 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:03 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-85fc779d-b59f-4de6-8e6f-1012123ad624 req-b5e55e9a-7f66-4a13-a76e-187480bb4e79 tempest-AttachVolumeTestJSON-563296492 None] Terminate volume connection completed successfully. Jul 05 02:46:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-85fc779d-b59f-4de6-8e6f-1012123ad624 req-b5e55e9a-7f66-4a13-a76e-187480bb4e79 tempest-AttachVolumeTestJSON-563296492 None] Deleting attachment b6e38e5f-c4c8-40d4-8b7f-517a688d8045. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:46:04 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58" returned: 0 in 0.810s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623eb2f0-bb92-493d-abc8-d44270b6b52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:46:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:46:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:46:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d2a3aa-f9a5-4372-a31a-fd4ca848c3e1]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:04 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e Jul 05 02:46:04 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:04 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.753s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:04 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:04 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Deleted volume successfully. Jul 05 02:46:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e32d6272-e999-49e4-a187-8f235a983618 tempest-SnapshotDependencyTests-1543001073 None] Lock "cinder-67a344bd-a9c4-466a-85a3-df67b4697d6f-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:05 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e" returned: 0 in 0.859s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:05 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:46:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:05 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 Jul 05 02:46:05 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:46:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:05 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:05 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:06 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.857s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:46:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:46:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:46:11 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0" returned: 0 in 6.397s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:11 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4794b15-3818-4fc5-ad18-20faabc3d4c1]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:11 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e Jul 05 02:46:11 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:12 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e" returned: 0 in 1.100s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:12 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:46:12 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Converted 1024.00 MB image at 160.06 MB/s Jul 05 02:46:12 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 is being set with open permissions: ugo+rw Jul 05 02:46:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:12 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 Jul 05 02:46:12 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:13 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0" returned: 0 in 0.690s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-cda4358b-c7f7-4137-ac38-7cf4d033b5b0" released by "_copy_volume_from_snapshot" :: held 9.941s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-quobyte-ee4596e4-982b-4ab9-884c-62c7ee0d0e58" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-ee4596e4-982b-4ab9-884c-62c7ee0d0e58" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Deleting offline snapshot ee4596e4-982b-4ab9-884c-62c7ee0d0e58 of volume 623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:46:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] snapshot_file for this snap is: volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:46:13 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca5988-35f9-4bb3-b02a-c2e0d63becf8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:13 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 Jul 05 02:46:13 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:14 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58" returned: 0 in 0.790s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623eb2f0-bb92-493d-abc8-d44270b6b52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:46:14 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[59371438-8aae-467b-ab9c-4805e0bfb539]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:14 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e Jul 05 02:46:14 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:14 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=42,cinder:SELECT=40,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:46:14 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e" returned: 0 in 0.863s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:15 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 Jul 05 02:46:15 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:15 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58" returned: 0 in 0.865s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:15 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58 Jul 05 02:46:15 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:16 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e.ee4596e4-982b-4ab9-884c-62c7ee0d0e58" returned: 0 in 0.724s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "cinder-1b2c94a2-8971-4138-ac0c-43507adea791-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-ee4596e4-982b-4ab9-884c-62c7ee0d0e58" released by "_delete_snapshot" :: held 3.379s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-1b2c94a2-8971-4138-ac0c-43507adea791-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "cinder-quobyte-1b2c94a2-8971-4138-ac0c-43507adea791" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.614s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.454s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1268763411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b38014-53af-4a64-b4e6-b7e75d894cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322ffa2204948a1a76240f661677c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:01Z,use_quota=True,user_id='302f3bb69c1647929c122847cb064604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Creating volume 92b38014-53af-4a64-b4e6-b7e75d894cab {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:46:16 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-quobyte-1b2c94a2-8971-4138-ac0c-43507adea791" acquired by "delete_volume" :: waited 0.055s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:16 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab 1073741824 Jul 05 02:46:16 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2904668-ba57-499c-9fd5-f1d94d5c45bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0', 'volume_size': 1, 'source_volid': '623eb2f0-bb92-493d-abc8-d44270b6b52e', 'source_volstatus': 'available'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03661941-20ed-49b8-81f4-6e59c26bf4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[941bc980-0db9-4af8-a15e-36f1682088d3]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:16 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Volume volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 (cda4358b-c7f7-4137-ac38-7cf4d033b5b0): created successfully Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03661941-20ed-49b8-81f4-6e59c26bf4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (d8764cfd-55c5-4588-8db5-81bfe44f34dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:16 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f7389f81-46d6-46c3-8e64-49ebd12c18b3 tempest-VolumesGetTest-227949493 None] Created volume successfully. Jul 05 02:46:16 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 Jul 05 02:46:16 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:17 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab 1073741824" returned: 0 in 0.920s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:17 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=107,cinder:UPDATE=124,cinder:DELETE=10,cinder:INSERT=30 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:46:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:17 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791" returned: 0 in 0.914s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:17 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab Jul 05 02:46:17 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:17 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791 Jul 05 02:46:17 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:18 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab" returned: 0 in 0.679s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94d77ae-39b9-4e77-a534-d47a4567867a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b38014-53af-4a64-b4e6-b7e75d894cab', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e27a8a-e770-40d9-97a6-1f28547261bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:18 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b2c94a2-8971-4138-ac0c-43507adea791" returned: 0 in 0.689s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-quobyte-1b2c94a2-8971-4138-ac0c-43507adea791" released by "delete_volume" :: held 1.664s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:18 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Volume volume-92b38014-53af-4a64-b4e6-b7e75d894cab (92b38014-53af-4a64-b4e6-b7e75d894cab): created successfully Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e27a8a-e770-40d9-97a6-1f28547261bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Flow 'volume_create_manager' (2ced5b12-1cd3-48a7-9d7a-9cbc950c2f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-7d75a45a-9065-4e7c-a26b-ef8045775cae tempest-VolumeQuotasAdminTestJSON-1207331132 None] Created volume successfully. Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Created reservations ['db3646b0-6a7b-45a0-9de3-59234f39ad98', '4bf8c52f-7e52-40cc-9f41-13aa8cce4be1', 'c061869e-e1eb-49ad-bc41-cf649b567824', 'b18d2c2c-690e-4c96-8daa-ddfbea1d8c7f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (865707e6-212a-43b8-a7ce-e88123bd86d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb724d5d-5883-4311-9f1c-9d374072cb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb724d5d-5883-4311-9f1c-9d374072cb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1273143636',display_name='tempest-VolumesGetTest-Volume-2050953393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3908ede6-8d2a-4b02-b63c-e58a3a3692dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:18Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd29662-ec6a-4304-bd00-686ca11b2937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd29662-ec6a-4304-bd00-686ca11b2937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ef336b-0d62-4e61-a709-915795648a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ef336b-0d62-4e61-a709-915795648a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3908ede6-8d2a-4b02-b63c-e58a3a3692dc', 'volume_name': 'volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dbdf07-7cb0-4afe-8348-53157d09cdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dbdf07-7cb0-4afe-8348-53157d09cdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66d8b2e-13a5-45b9-b605-a2dbd6d4d164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:18 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Volume 3908ede6-8d2a-4b02-b63c-e58a3a3692dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc', 'volume_size': 1} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1273143636',display_name='tempest-VolumesGetTest-Volume-2050953393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3908ede6-8d2a-4b02-b63c-e58a3a3692dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:18Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Creating volume 3908ede6-8d2a-4b02-b63c-e58a3a3692dc {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:46:18 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:18 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc 1073741824 Jul 05 02:46:18 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Acquiring lock "cinder-92b38014-53af-4a64-b4e6-b7e75d894cab-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:18 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:18 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "cinder-92b38014-53af-4a64-b4e6-b7e75d894cab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Acquiring lock "cinder-quobyte-92b38014-53af-4a64-b4e6-b7e75d894cab" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "cinder-quobyte-92b38014-53af-4a64-b4e6-b7e75d894cab" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc85779-5a76-4fe7-bd38-9b21f6fefe8b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "cinder-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "cinder-quobyte-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-quobyte-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:19 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab Jul 05 02:46:19 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[93848695-2bab-4595-bad6-f79dd812117b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:19 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e Jul 05 02:46:19 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:19 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.790s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:19 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Deleted volume successfully. Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4559fb8c-b343-449c-a8b6-fdbca86f7a60 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-1b2c94a2-8971-4138-ac0c-43507adea791-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:19 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc 1073741824" returned: 0 in 0.890s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:19 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc Jul 05 02:46:19 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:19 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab" returned: 0 in 0.879s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:19 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab Jul 05 02:46:19 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:19 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e" returned: 0 in 0.829s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:19 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e Jul 05 02:46:19 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:20 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc" returned: 0 in 0.690s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66d8b2e-13a5-45b9-b605-a2dbd6d4d164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c505ba66-5504-4e33-a8bc-ce4d496a8f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:20 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Volume volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc (3908ede6-8d2a-4b02-b63c-e58a3a3692dc): created successfully Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c505ba66-5504-4e33-a8bc-ce4d496a8f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (865707e6-212a-43b8-a7ce-e88123bd86d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9ecd489a-d82a-4a45-8100-46c4821322f9 tempest-VolumesGetTest-227949493 None] Created volume successfully. Jul 05 02:46:20 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-92b38014-53af-4a64-b4e6-b7e75d894cab" returned: 0 in 0.680s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "cinder-quobyte-92b38014-53af-4a64-b4e6-b7e75d894cab" released by "delete_volume" :: held 1.620s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Created reservations ['e78da6dd-5a3a-42f2-8319-2c04d6afeeae', '8a21925c-2558-4e85-a0a2-9ccff27318c9', '93828bc8-5351-49ec-bfca-29a9e49c31c6', '1d1dac44-0924-4b77-b3ca-88d48049ae8c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:20 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:20 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:20 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e" returned: 0 in 0.682s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-quobyte-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e" released by "delete_volume" :: held 1.558s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Created reservations ['692f3c21-0b25-4815-b6b0-af23d1263522', '10279bf5-f761-48e7-9afa-10eb10b226fc', '39dc1e11-5a5b-4ce9-9f87-b75dc698c78b', '801561a9-d3f2-4cd0-ae83-7a33f32cbcfb'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:20 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:20 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-3908ede6-8d2a-4b02-b63c-e58a3a3692dc-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Lock "cinder-3908ede6-8d2a-4b02-b63c-e58a3a3692dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-quobyte-3908ede6-8d2a-4b02-b63c-e58a3a3692dc" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-3908ede6-8d2a-4b02-b63c-e58a3a3692dc" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c444fc6f-cdb5-4184-a08b-7dde69f16e84]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:21 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc Jul 05 02:46:21 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:21 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.719s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Deleted volume successfully. Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5f3fa141-6c09-44f1-bae5-e13cf17cf9d1 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "cinder-92b38014-53af-4a64-b4e6-b7e75d894cab-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "cinder-6a9b7c97-e6e5-492a-b4fb-8c26dead457e-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-6a9b7c97-e6e5-492a-b4fb-8c26dead457e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:21 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.762s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Deleted volume successfully. Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "cinder-quobyte-6a9b7c97-e6e5-492a-b4fb-8c26dead457e" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b559441c-b51e-4870-ba67-0742c15223a3 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-0ce21d3b-23a4-41e9-9c3f-630ceb32fe6e-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-quobyte-6a9b7c97-e6e5-492a-b4fb-8c26dead457e" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ef9182-ecd2-4a62-a442-a685b289b2e9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Flow 'volume_create_manager' (09f46474-7000-4a8a-bab3-5062e8d43b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18719aa1-fdc3-4107-97b0-6b42930ee8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18719aa1-fdc3-4107-97b0-6b42930ee8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1895971347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0866a3c8-538c-4362-ab5e-d6a0c589c244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322ffa2204948a1a76240f661677c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:22Z,use_quota=True,user_id='302f3bb69c1647929c122847cb064604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:21 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e Jul 05 02:46:21 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daba9f58-3d72-400a-8e81-d2318c9f9f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daba9f58-3d72-400a-8e81-d2318c9f9f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1271df2a-7054-4dda-a3d1-5fbf272be631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1271df2a-7054-4dda-a3d1-5fbf272be631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0866a3c8-538c-4362-ab5e-d6a0c589c244', 'volume_name': 'volume-0866a3c8-538c-4362-ab5e-d6a0c589c244', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17ef8f7-c8b7-4475-bf98-5601cea25c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17ef8f7-c8b7-4475-bf98-5601cea25c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4a7ca5-11f1-4069-afed-60d60c5adc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:21 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Volume 0866a3c8-538c-4362-ab5e-d6a0c589c244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0866a3c8-538c-4362-ab5e-d6a0c589c244', 'volume_size': 1} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1895971347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0866a3c8-538c-4362-ab5e-d6a0c589c244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322ffa2204948a1a76240f661677c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:22Z,use_quota=True,user_id='302f3bb69c1647929c122847cb064604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Creating volume 0866a3c8-538c-4362-ab5e-d6a0c589c244 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:46:21 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:21 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244 1073741824 Jul 05 02:46:21 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:21 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc" returned: 0 in 0.899s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:21 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc Jul 05 02:46:21 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:22 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e" returned: 0 in 0.803s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:22 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e Jul 05 02:46:22 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:22 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3908ede6-8d2a-4b02-b63c-e58a3a3692dc" returned: 0 in 0.684s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:22 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-3908ede6-8d2a-4b02-b63c-e58a3a3692dc" released by "delete_volume" :: held 1.648s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244 1073741824" returned: 0 in 0.867s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:22 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244 Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Created reservations ['9ba59bc1-3294-4e44-b6cb-506ecb742e9c', '52954c94-58bc-4e66-a34b-c286e442fee1', '07df0a41-8ece-4101-9dfa-6d5fb3dad3e6', '535e39a8-82f6-4d66-8877-622af84a8a69'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:22 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:22 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:22 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:23 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6a9b7c97-e6e5-492a-b4fb-8c26dead457e" returned: 0 in 0.706s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-quobyte-6a9b7c97-e6e5-492a-b4fb-8c26dead457e" released by "delete_volume" :: held 1.554s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-cda4358b-c7f7-4137-ac38-7cf4d033b5b0-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Created reservations ['43f68e15-58c3-46a5-9fef-32582fa32bf3', '7f2ecc13-ab33-4305-a531-b158903dcaab', '5dd72411-c2af-473d-b334-add77738e376', '5b315a82-bb1a-4260-b744-dd4b2db44d2e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Lock "cinder-cda4358b-c7f7-4137-ac38-7cf4d033b5b0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-quobyte-cda4358b-c7f7-4137-ac38-7cf4d033b5b0" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-cda4358b-c7f7-4137-ac38-7cf4d033b5b0" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7ac178-dac9-43fd-b52e-34c85817e8f9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:23 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244" returned: 0 in 0.757s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4a7ca5-11f1-4069-afed-60d60c5adc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0866a3c8-538c-4362-ab5e-d6a0c589c244', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80e306a-e80b-4ed8-9efa-0c1b63f045ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:23 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:23 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:23 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Volume volume-0866a3c8-538c-4362-ab5e-d6a0c589c244 (0866a3c8-538c-4362-ab5e-d6a0c589c244): created successfully Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80e306a-e80b-4ed8-9efa-0c1b63f045ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Flow 'volume_create_manager' (09f46474-7000-4a8a-bab3-5062e8d43b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:23 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c0cc9fa6-5eb2-4a23-8220-f9c8d706dc33 tempest-VolumeQuotasAdminTestJSON-1207331132 None] Created volume successfully. Jul 05 02:46:23 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 Jul 05 02:46:23 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:23 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.808s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:23 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Deleted volume successfully. Jul 05 02:46:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a4d73c1b-3fce-4ded-8671-7fad5e77e91f tempest-VolumesGetTest-227949493 None] Lock "cinder-3908ede6-8d2a-4b02-b63c-e58a3a3692dc-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:24 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.800s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:24 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Deleted volume successfully. Jul 05 02:46:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bb0f6ad4-7487-47bc-9ee2-19c00bd99ba0 tempest-AttachVolumeTestJSON-563296492 None] Lock "cinder-6a9b7c97-e6e5-492a-b4fb-8c26dead457e-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:24 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0" returned: 0 in 0.926s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:24 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0 Jul 05 02:46:24 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a6423bed-5578-4180-86a8-88c7f942da9d tempest-VolumeQuotasAdminTestJSON-620896195 None] Transfer volume completed successfully. Jul 05 02:46:25 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-cda4358b-c7f7-4137-ac38-7cf4d033b5b0" returned: 0 in 0.758s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-cda4358b-c7f7-4137-ac38-7cf4d033b5b0" released by "delete_volume" :: held 1.730s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Created reservations ['36441c3e-268f-407c-9872-be095dce0113', 'e69c9dd1-edf0-46ca-9ada-c321149e7970', '2fe626b7-4903-4642-a485-b541bb249ed3', 'd79053b3-8b7e-4f53-a9e5-8e7acb81978f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:25 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:25 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-623eb2f0-bb92-493d-abc8-d44270b6b52e-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Lock "cinder-623eb2f0-bb92-493d-abc8-d44270b6b52e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-quobyte-623eb2f0-bb92-493d-abc8-d44270b6b52e" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-623eb2f0-bb92-493d-abc8-d44270b6b52e" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Acquiring lock "cinder-0866a3c8-538c-4362-ab5e-d6a0c589c244-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a9e7d4-4aac-4c74-b546-db9effa841ee]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Lock "cinder-0866a3c8-538c-4362-ab5e-d6a0c589c244-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Acquiring lock "cinder-quobyte-0866a3c8-538c-4362-ab5e-d6a0c589c244" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Lock "cinder-quobyte-0866a3c8-538c-4362-ab5e-d6a0c589c244" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c453441e-1de7-4614-8cfe-573230d8f141]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:25 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e Jul 05 02:46:25 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:25 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.803s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:25 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Deleted volume successfully. Jul 05 02:46:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-18347c53-46ce-4fef-b3f8-9836deed0842 tempest-VolumesGetTest-227949493 None] Lock "cinder-cda4358b-c7f7-4137-ac38-7cf4d033b5b0-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:26 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244 Jul 05 02:46:26 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:26 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e" returned: 0 in 0.858s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:26 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e Jul 05 02:46:26 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:26 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244" returned: 0 in 0.877s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:26 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244 Jul 05 02:46:26 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:27 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-623eb2f0-bb92-493d-abc8-d44270b6b52e" returned: 0 in 0.773s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-623eb2f0-bb92-493d-abc8-d44270b6b52e" released by "delete_volume" :: held 1.737s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Created reservations ['bf538104-c958-41c3-9ebb-b8524999aaee', '6c1548ca-1df6-48af-baff-edc758c80587', 'caa10837-1d91-45cd-bdff-69e9f4215987', 'dad39113-9506-48d4-951d-57a26acc44e1'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:27 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-0866a3c8-538c-4362-ab5e-d6a0c589c244" returned: 0 in 0.842s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:27 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:27 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Lock "cinder-quobyte-0866a3c8-538c-4362-ab5e-d6a0c589c244" released by "delete_volume" :: held 1.774s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Created reservations ['fabea8ef-b8e3-4b67-8da3-02ca95e74185', '568aa215-d680-4544-99e2-bcca1a7b532e', '00c376c9-c7a3-4843-8acd-74361d4de33a', '689f7279-9d42-4e64-919b-9ea7beb9b0ed'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:27 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:27 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:28 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.839s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:28 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Deleted volume successfully. Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8002d4aa-f702-4156-81c2-5bd30227dccd tempest-VolumesGetTest-227949493 None] Lock "cinder-623eb2f0-bb92-493d-abc8-d44270b6b52e-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:28 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.830s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:28 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Deleted volume successfully. Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e7c3fb0-39c5-449d-ae79-23201e3145c9 tempest-VolumeQuotasAdminTestJSON-938188136 None] Lock "cinder-0866a3c8-538c-4362-ab5e-d6a0c589c244-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (b5d24b2c-7fb4-4028-8a13-1b4838c1dc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0edd2aa-4123-4074-8464-a13a6a823d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0edd2aa-4123-4074-8464-a13a6a823d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-324616552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d419e303-1467-4a19-9c41-80ee96882719,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:29Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a019fb80-c542-45df-b689-608ece5bf0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a019fb80-c542-45df-b689-608ece5bf0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4c120d-86e9-46c8-bef3-d38db3f55566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:28 devstack cinder-volume[86671]: DEBUG cinder.image.glance [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Creating Keystone auth plugin from conf {{(pid=86671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 02:46:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4c120d-86e9-46c8-bef3-d38db3f55566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd419e303-1467-4a19-9c41-80ee96882719', 'volume_name': 'volume-d419e303-1467-4a19-9c41-80ee96882719', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3838b79a-fd42-4f28-9706-a52e21c6549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3838b79a-fd42-4f28-9706-a52e21c6549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbeed44-8b82-4208-a8a6-00afe04c212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:29 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Volume d419e303-1467-4a19-9c41-80ee96882719: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d419e303-1467-4a19-9c41-80ee96882719', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 02:46:29 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Trying to clone d419e303-1467-4a19-9c41-80ee96882719 from image c1baa924-f45f-4a01-ae62-ac21392667fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]). {{(pid=86671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 05 02:46:30 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 02:46:30 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Image download 20.69 MB at 20.69 MB/s Jul 05 02:46:30 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad52b0b5-d000-41cb-8ec0-edfdc8d611c8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:30 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD Jul 05 02:46:30 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:31 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Temporary image c1baa924-f45f-4a01-ae62-ac21392667fc is fetched for user c2d7a02e28d543508d131ed71b303fee. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd1b262-0af1-481e-a046-e86c5263d15a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:31 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD Jul 05 02:46:31 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:31 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-324616552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d419e303-1467-4a19-9c41-80ee96882719,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:29Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Creating volume d419e303-1467-4a19-9c41-80ee96882719 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:46:31 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:46:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:31 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 1073741824 Jul 05 02:46:31 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-60b0f379-13bf-4432-b178-5846e467f962 tempest-GroupSnapshotsV319Test-1819210260 None] Group tempest-GroupSnapshotsV319Test-Group-1783242903: creating Jul 05 02:46:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-60b0f379-13bf-4432-b178-5846e467f962 tempest-GroupSnapshotsV319Test-1819210260 None] Group tempest-GroupSnapshotsV319Test-Group-1783242903: created successfully Jul 05 02:46:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-60b0f379-13bf-4432-b178-5846e467f962 tempest-GroupSnapshotsV319Test-1819210260 None] Create group completed successfully. Jul 05 02:46:32 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 1073741824" returned: 0 in 0.954s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:32 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 Jul 05 02:46:32 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:33 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719" returned: 0 in 0.688s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:46:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:33 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Attempting download of c1baa924-f45f-4a01-ae62-ac21392667fc ((None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}])) to volume d419e303-1467-4a19-9c41-80ee96882719. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 02:46:33 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a283bd59-2519-4209-b87d-ada1191c8df0]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_cyh5mij_ {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:33 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_cyh5mij_ Jul 05 02:46:33 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:33 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:46:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Flow 'volume_create_manager' (bee6c603-6e7b-4189-a156-7f2beb3d0ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286602f7-598b-4ef6-ac98-b2d9938bdda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286602f7-598b-4ef6-ac98-b2d9938bdda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1987558614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7e422da-74e1-4259-ac43-e2c6463f9954,host='devstack@QuobyteHD#QuobyteHD',id=00309708-8618-450f-a0d4-2f037011a951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df19671783b4d0795d7de5ed1ae2fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:34Z,use_quota=True,user_id='518c780c164c4c378d2311cef2202128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc39e262-928d-4510-8c8f-62e75b931a6f),volume_type_id=cc39e262-928d-4510-8c8f-62e75b931a6f)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7279e2-8f46-44c6-a190-a4b1825b6703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7279e2-8f46-44c6-a190-a4b1825b6703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6578fe2-fd47-40b8-b362-5dd1226ff143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6578fe2-fd47-40b8-b362-5dd1226ff143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00309708-8618-450f-a0d4-2f037011a951', 'volume_name': 'volume-00309708-8618-450f-a0d4-2f037011a951', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15176c19-fb93-4ae5-a67a-f26f3bfe179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15176c19-fb93-4ae5-a67a-f26f3bfe179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a514bd-9f5d-4c11-a1c7-bab6f23c5a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:34 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Volume 00309708-8618-450f-a0d4-2f037011a951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00309708-8618-450f-a0d4-2f037011a951', 'volume_size': 1} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a7e422da-74e1-4259-ac43-e2c6463f9954,created_at=2026-07-05T00:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1987558614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7e422da-74e1-4259-ac43-e2c6463f9954,host='devstack@QuobyteHD#QuobyteHD',id=00309708-8618-450f-a0d4-2f037011a951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3df19671783b4d0795d7de5ed1ae2fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:34Z,use_quota=True,user_id='518c780c164c4c378d2311cef2202128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc39e262-928d-4510-8c8f-62e75b931a6f),volume_type_id=cc39e262-928d-4510-8c8f-62e75b931a6f)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Creating volume 00309708-8618-450f-a0d4-2f037011a951 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:46:34 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:34 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 1073741824 Jul 05 02:46:34 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:34 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_cyh5mij_" returned: 0 in 0.786s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_cyh5mij_ {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:34 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_cyh5mij_ Jul 05 02:46:34 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:34 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 1073741824" returned: 0 in 0.880s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:35 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 Jul 05 02:46:35 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:35 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_cyh5mij_" returned: 1 in 0.800s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_cyh5mij_' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[248c945e-3106-49ee-bae4-495a76b4bd1c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:35 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD Jul 05 02:46:35 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:35 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951" returned: 0 in 0.701s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a514bd-9f5d-4c11-a1c7-bab6f23c5a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00309708-8618-450f-a0d4-2f037011a951', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ae7367-f174-48b8-bdf8-002535cc6fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:35 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Volume volume-00309708-8618-450f-a0d4-2f037011a951 (00309708-8618-450f-a0d4-2f037011a951): created successfully Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ae7367-f174-48b8-bdf8-002535cc6fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Flow 'volume_create_manager' (bee6c603-6e7b-4189-a156-7f2beb3d0ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0e5d5079-dd1b-40f8-adab-7d23574e2690 tempest-GroupSnapshotsV319Test-1819210260 None] Created volume successfully. Jul 05 02:46:36 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:36 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] c1baa924-f45f-4a01-ae62-ac21392667fc was qcow2, converting to raw {{(pid=86671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 02:46:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:36 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 Jul 05 02:46:36 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] GroupSnapshot 73a6b76c-5447-4674-9a85-40aab507458a: creating. Jul 05 02:46:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Group snapshot 73a6b76c-5447-4674-9a85-40aab507458a: creating. {{(pid=86671) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4177}} Jul 05 02:46:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Creating offline snapshot a0e1a381-a750-4956-bf59-a754b0a3c3fa of volume 00309708-8618-450f-a0d4-2f037011a951 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:46:36 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd35b091-eeff-4beb-bdf4-1600c716f093]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:36 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 Jul 05 02:46:36 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:37 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951" returned: 0 in 0.948s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:37 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa 1G Jul 05 02:46:37 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:38 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719" returned: 0 in 2.197s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:38 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_iqpk3t3mdevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:46:38 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Converted 112.00 MB image at 50.95 MB/s Jul 05 02:46:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:38 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 1G Jul 05 02:46:38 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:38 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa 1G" returned: 0 in 0.973s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00309708-8618-450f-a0d4-2f037011a951 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:38 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00309708-8618-450f-a0d4-2f037011a951 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa Jul 05 02:46:38 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:39 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 1G" returned: 0 in 0.811s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:39 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3837db21-9edd-40fa-8f01-8bbe509ed74d]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:39 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 Jul 05 02:46:39 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:39 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00309708-8618-450f-a0d4-2f037011a951 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa" returned: 0 in 0.770s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:39 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:46:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:39 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa Jul 05 02:46:39 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:39 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719" returned: 0 in 0.833s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:40 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa" returned: 0 in 0.675s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:40 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 Jul 05 02:46:40 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:40 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.info Jul 05 02:46:40 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:40 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719" returned: 1 in 0.842s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Downloaded image c1baa924-f45f-4a01-ae62-ac21392667fc ((None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}])) to volume d419e303-1467-4a19-9c41-80ee96882719 successfully. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Temporary image c1baa924-f45f-4a01-ae62-ac21392667fc for user c2d7a02e28d543508d131ed71b303fee is deleted. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Marking volume d419e303-1467-4a19-9c41-80ee96882719 as bootable. {{(pid=86671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Copying metadata from image c1baa924-f45f-4a01-ae62-ac21392667fc to d419e303-1467-4a19-9c41-80ee96882719. {{(pid=86671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Creating volume glance metadata for volume d419e303-1467-4a19-9c41-80ee96882719 backed by image c1baa924-f45f-4a01-ae62-ac21392667fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 02:46:40 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.info" returned: 0 in 0.744s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:40 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:40 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.info Jul 05 02:46:40 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbeed44-8b82-4208-a8a6-00afe04c212c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d419e303-1467-4a19-9c41-80ee96882719', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65aa2937-b8df-4556-9b04-63f3aebe0705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:40 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Volume volume-d419e303-1467-4a19-9c41-80ee96882719 (d419e303-1467-4a19-9c41-80ee96882719): created successfully Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65aa2937-b8df-4556-9b04-63f3aebe0705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (b5d24b2c-7fb4-4028-8a13-1b4838c1dc90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e80f643e-5b74-441a-8c33-26804884a193 tempest-VolumesGetTest-227949493 None] Created volume successfully. Jul 05 02:46:41 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.info" returned: 0 in 0.682s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.886s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:41 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ac7a3154-b53d-47b3-82be-4fe0f4604944 tempest-GroupSnapshotsV319Test-1819210260 None] group_snapshot 73a6b76c-5447-4674-9a85-40aab507458a: created successfully Jul 05 02:46:42 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] group_snapshot 73a6b76c-5447-4674-9a85-40aab507458a: deleting Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] group_snapshot 73a6b76c-5447-4674-9a85-40aab507458a: deleting {{(pid=86671) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4352}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Acquiring lock "cinder-quobyte-00309708-8618-450f-a0d4-2f037011a951" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Lock "cinder-quobyte-00309708-8618-450f-a0d4-2f037011a951" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Acquiring lock "cinder-quobyte-a0e1a381-a750-4956-bf59-a754b0a3c3fa" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Lock "cinder-quobyte-a0e1a381-a750-4956-bf59-a754b0a3c3fa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Deleting offline snapshot a0e1a381-a750-4956-bf59-a754b0a3c3fa of volume 00309708-8618-450f-a0d4-2f037011a951 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] snapshot_file for this snap is: volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f390f-5e57-46ae-b527-6a198e815115]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (808cf988-b19f-4dc1-afc7-e2c39b08332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db02aea-d507-4544-89df-28151fe41d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db02aea-d507-4544-89df-28151fe41d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1828906528',display_name='tempest-VolumesGetTest-Volume-1671587396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13312da0-7716-4b99-a389-d10084e03f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:42Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:42 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa Jul 05 02:46:42 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef7d33a-17fa-4a9c-b19e-20160c5186a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef7d33a-17fa-4a9c-b19e-20160c5186a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c018b51-4987-485c-916c-ccb834862d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c018b51-4987-485c-916c-ccb834862d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13312da0-7716-4b99-a389-d10084e03f0e', 'volume_name': 'volume-13312da0-7716-4b99-a389-d10084e03f0e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d84269d-c2e9-4307-838c-359c2f719966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d84269d-c2e9-4307-838c-359c2f719966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851c4eeb-41bf-48d4-a044-896fc9fb7ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:42 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Volume 13312da0-7716-4b99-a389-d10084e03f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13312da0-7716-4b99-a389-d10084e03f0e', 'volume_size': 1} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1828906528',display_name='tempest-VolumesGetTest-Volume-1671587396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13312da0-7716-4b99-a389-d10084e03f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ba5a7e8a0f41f7b08e2af980ce45a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:42Z,use_quota=True,user_id='c2d7a02e28d543508d131ed71b303fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Creating volume 13312da0-7716-4b99-a389-d10084e03f0e {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:46:42 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:46:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:42 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e 1073741824 Jul 05 02:46:42 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Flow 'volume_create_manager' (7e24d002-02eb-4973-a806-63c6356ba587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ff3bd0-b25c-45b7-a02e-0206c46d253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ff3bd0-b25c-45b7-a02e-0206c46d253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-869947733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166843cd-84a6-4bfb-b484-f0ed79673235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23694ab9b7904739a44dab9ed1984b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:43Z,use_quota=True,user_id='e9b786e443304e5690dcce13e3a88736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1d09e4-5d29-4b6f-bf83-a30e41909ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1d09e4-5d29-4b6f-bf83-a30e41909ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b52d61-0388-415d-acc0-79d648030a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b52d61-0388-415d-acc0-79d648030a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166843cd-84a6-4bfb-b484-f0ed79673235', 'volume_name': 'volume-166843cd-84a6-4bfb-b484-f0ed79673235', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d918af-6199-4644-968d-55effa43c651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d918af-6199-4644-968d-55effa43c651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0254e3-aa82-4ec4-94b9-71cb586341e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:43 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Volume 166843cd-84a6-4bfb-b484-f0ed79673235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166843cd-84a6-4bfb-b484-f0ed79673235', 'volume_size': 1} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:43 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa" returned: 0 in 0.839s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00309708-8618-450f-a0d4-2f037011a951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1155ac55-3ee3-4d97-b205-bffd06ba1255]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:43 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 Jul 05 02:46:43 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:43 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e 1073741824" returned: 0 in 0.859s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:43 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e Jul 05 02:46:43 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:44 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951" returned: 0 in 0.802s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:44 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa Jul 05 02:46:44 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:44 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e" returned: 0 in 0.668s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.070s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-869947733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166843cd-84a6-4bfb-b484-f0ed79673235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23694ab9b7904739a44dab9ed1984b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:43Z,use_quota=True,user_id='e9b786e443304e5690dcce13e3a88736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Creating volume 166843cd-84a6-4bfb-b484-f0ed79673235 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:46:44 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851c4eeb-41bf-48d4-a044-896fc9fb7ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13312da0-7716-4b99-a389-d10084e03f0e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f20660-43f5-4eb8-b2eb-cb38f82b5c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:44 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 1073741824 Jul 05 02:46:44 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:44 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Volume volume-13312da0-7716-4b99-a389-d10084e03f0e (13312da0-7716-4b99-a389-d10084e03f0e): created successfully Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f20660-43f5-4eb8-b2eb-cb38f82b5c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Flow 'volume_create_manager' (808cf988-b19f-4dc1-afc7-e2c39b08332f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f0d842d1-51d6-4873-aa0f-626620d23314 tempest-VolumesGetTest-227949493 None] Created volume successfully. Jul 05 02:46:44 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa" returned: 0 in 0.794s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:44 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa Jul 05 02:46:44 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-13312da0-7716-4b99-a389-d10084e03f0e-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Lock "cinder-13312da0-7716-4b99-a389-d10084e03f0e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-quobyte-13312da0-7716-4b99-a389-d10084e03f0e" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-13312da0-7716-4b99-a389-d10084e03f0e" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92fd07c-529d-48aa-9adf-b0e1e0b67317]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:45 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 1073741824" returned: 0 in 0.922s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:45 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e Jul 05 02:46:45 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:45 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 Jul 05 02:46:45 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:45 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951.a0e1a381-a750-4956-bf59-a754b0a3c3fa" returned: 0 in 0.695s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Lock "cinder-quobyte-a0e1a381-a750-4956-bf59-a754b0a3c3fa" released by "_delete_snapshot" :: held 3.225s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Lock "cinder-quobyte-00309708-8618-450f-a0d4-2f037011a951" released by "delete_snapshot" :: held 3.256s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:45 devstack cinder-volume[86671]: WARNING cinder.quota [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-564111745 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-564111745, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:46:45 devstack cinder-volume[86671]: WARNING cinder.quota [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-564111745 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-564111745, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] Created reservations ['2285d4fa-86fc-4493-ab3d-e801602f156f', 'd4abf87a-561d-455b-bb1c-6ac44fdffc22', '33628b5c-86a8-4612-afe8-e9f64bff3d6a', '3dc46ff5-91d9-4a10-9e78-b54278e5a858'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-88e238d9-79ee-407e-88aa-7d9243e10040 tempest-GroupSnapshotsV319Test-1819210260 None] group_snapshot 73a6b76c-5447-4674-9a85-40aab507458a: deleted successfully Jul 05 02:46:45 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235" returned: 0 in 0.683s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0254e3-aa82-4ec4-94b9-71cb586341e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166843cd-84a6-4bfb-b484-f0ed79673235', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:45 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f83dff-9c6b-4fa5-882c-869313575931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e" returned: 0 in 0.804s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:45 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Volume volume-166843cd-84a6-4bfb-b484-f0ed79673235 (166843cd-84a6-4bfb-b484-f0ed79673235): created successfully Jul 05 02:46:45 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e Jul 05 02:46:45 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f83dff-9c6b-4fa5-882c-869313575931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Flow 'volume_create_manager' (7e24d002-02eb-4973-a806-63c6356ba587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d461f5ca-4907-4200-bae3-61afde7cd148 tempest-SnapshotMetadataTestJSON-1556830957 None] Created volume successfully. Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Creating offline snapshot 2b91ce33-d2f1-4434-863e-0966f613f5f3 of volume 166843cd-84a6-4bfb-b484-f0ed79673235 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c2e4f-6eb7-4458-8e53-38adc8443954]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:46 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:46 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 Jul 05 02:46:46 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-13312da0-7716-4b99-a389-d10084e03f0e" returned: 0 in 0.654s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-13312da0-7716-4b99-a389-d10084e03f0e" released by "delete_volume" :: held 1.505s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Created reservations ['ce79370d-f1db-42a8-bd12-2a5b2b1cd632', '013c4563-2538-41fd-a256-26830ccf51e5', 'ae5c0551-a35c-4306-85c3-95011f3b431c', '1eab4213-7259-4439-bb0e-96cc8a20908a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:46 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:46 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Acquiring lock "cinder-quobyte-00309708-8618-450f-a0d4-2f037011a951" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Lock "cinder-quobyte-00309708-8618-450f-a0d4-2f037011a951" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d7fd70-dc44-429d-a46d-2217fabd6eaa]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:47 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-d419e303-1467-4a19-9c41-80ee96882719-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235" returned: 0 in 0.867s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Lock "cinder-d419e303-1467-4a19-9c41-80ee96882719-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:47 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 Jul 05 02:46:47 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:47 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 1G Jul 05 02:46:47 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Acquiring lock "cinder-quobyte-d419e303-1467-4a19-9c41-80ee96882719" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-d419e303-1467-4a19-9c41-80ee96882719" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[918a13cc-c358-4c6a-bc3f-8536c6de2ed1]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:47 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.811s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:47 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Deleted volume successfully. Jul 05 02:46:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-276d355f-78e0-42f6-91b6-40ad986919d4 tempest-VolumesGetTest-227949493 None] Lock "cinder-13312da0-7716-4b99-a389-d10084e03f0e-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:47 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 Jul 05 02:46:47 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:48 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951" returned: 0 in 0.908s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:48 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951 Jul 05 02:46:48 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:48 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 1G" returned: 0 in 0.898s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166843cd-84a6-4bfb-b484-f0ed79673235 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:48 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166843cd-84a6-4bfb-b484-f0ed79673235 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 Jul 05 02:46:48 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:48 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719" returned: 0 in 0.790s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:48 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 Jul 05 02:46:48 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:48 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00309708-8618-450f-a0d4-2f037011a951" returned: 0 in 0.695s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Lock "cinder-quobyte-00309708-8618-450f-a0d4-2f037011a951" released by "delete_volume" :: held 1.676s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Created reservations ['292b5e1b-f67d-40be-9eda-c18638307e42'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:48 devstack cinder-volume[86671]: WARNING cinder.quota [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-564111745 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-564111745, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Created reservations ['d84c8238-868b-4d3e-a31d-482aabcf9b23', 'd900fea5-4331-4704-ac45-57a3747ba9c7', '06e267b8-7088-45e7-b5d7-ce754aa12ea2', 'e9ecfc44-e3e8-4354-a6be-448aabc30100'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:48 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-166843cd-84a6-4bfb-b484-f0ed79673235 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3" returned: 0 in 0.765s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:48 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 is being set with open permissions: ugo+rw Jul 05 02:46:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:49 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 Jul 05 02:46:49 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:49 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719" returned: 1 in 0.846s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:49 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:49 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:49 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719 Jul 05 02:46:49 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:49 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3" returned: 0 in 0.734s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:49 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.info Jul 05 02:46:49 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:49 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.714s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:49 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-458f79a3-80e7-45cc-a268-11889fa5b9fe tempest-GroupSnapshotsV319Test-1819210260 None] Delete group completed successfully. Jul 05 02:46:49 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d419e303-1467-4a19-9c41-80ee96882719" returned: 0 in 0.720s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Lock "cinder-quobyte-d419e303-1467-4a19-9c41-80ee96882719" released by "delete_volume" :: held 2.438s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Created reservations ['b979bcb4-dda4-417b-ad38-20a4006b5575', 'c8eb8544-8679-4429-b0cb-97664d0ec639', 'cf5d5117-859a-40c6-bf59-0ceb2f710124', '4f834162-97ba-48a4-a967-1a063871bfa8'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:50 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:50 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:50 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.info" returned: 0 in 0.688s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:50 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.info is being set with open permissions: ugo+rw Jul 05 02:46:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:50 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.info Jul 05 02:46:50 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:50 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.673s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:50 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Deleted volume successfully. Jul 05 02:46:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3171daac-e2c8-48aa-af13-500dd3f76c8c tempest-VolumesGetTest-227949493 None] Lock "cinder-d419e303-1467-4a19-9c41-80ee96882719-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:51 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.info" returned: 0 in 0.795s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.862s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:51 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-441d503c-cd6f-4119-acf3-dd097789d8fe tempest-SnapshotMetadataTestJSON-1556830957 None] Create snapshot completed successfully Jul 05 02:46:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Acquiring lock "cinder-2b91ce33-d2f1-4434-863e-0966f613f5f3-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "cinder-2b91ce33-d2f1-4434-863e-0966f613f5f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Acquiring lock "cinder-quobyte-166843cd-84a6-4bfb-b484-f0ed79673235" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "cinder-quobyte-166843cd-84a6-4bfb-b484-f0ed79673235" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Acquiring lock "cinder-quobyte-2b91ce33-d2f1-4434-863e-0966f613f5f3" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "cinder-quobyte-2b91ce33-d2f1-4434-863e-0966f613f5f3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Deleting offline snapshot 2b91ce33-d2f1-4434-863e-0966f613f5f3 of volume 166843cd-84a6-4bfb-b484-f0ed79673235 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:46:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] snapshot_file for this snap is: volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:46:52 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d919d3be-fb82-4997-a28d-1150fcf87102]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:52 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 Jul 05 02:46:52 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:53 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3" returned: 0 in 0.810s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-166843cd-84a6-4bfb-b484-f0ed79673235(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:46:53 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00ff4e0-850a-48a4-a591-9505ebb9541e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:53 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 Jul 05 02:46:53 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:54 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235" returned: 0 in 0.818s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:46:54 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 Jul 05 02:46:54 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Flow 'volume_create_manager' (37d2920e-b63c-479c-b2df-8eb89d34de8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f035b16a-193f-4e90-819b-733902930154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f035b16a-193f-4e90-819b-733902930154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-310070183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc459604-7728-4f9e-b197-307169cc5b20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21e480c061a64b3888da13e760ba08b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:54Z,use_quota=True,user_id='eb5c5865bd3443efa6745135eff7db58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b20686e-fa83-4493-a0bc-c3d813042a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b20686e-fa83-4493-a0bc-c3d813042a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40bda26-3f23-41df-822d-cbbb113d167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40bda26-3f23-41df-822d-cbbb113d167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc459604-7728-4f9e-b197-307169cc5b20', 'volume_name': 'volume-dc459604-7728-4f9e-b197-307169cc5b20', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381980c8-fcb1-4b09-9a5f-dc2e8619d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381980c8-fcb1-4b09-9a5f-dc2e8619d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81825ed-60de-4d56-a3bc-8f2eed80fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:54 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Volume dc459604-7728-4f9e-b197-307169cc5b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc459604-7728-4f9e-b197-307169cc5b20', 'volume_size': 1} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-310070183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc459604-7728-4f9e-b197-307169cc5b20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21e480c061a64b3888da13e760ba08b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:54Z,use_quota=True,user_id='eb5c5865bd3443efa6745135eff7db58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Creating volume dc459604-7728-4f9e-b197-307169cc5b20 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:46:54 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:46:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:54 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20 1073741824 Jul 05 02:46:54 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:55 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3" returned: 0 in 0.834s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:55 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3 Jul 05 02:46:55 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:55 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20 1073741824" returned: 0 in 0.954s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:55 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20 Jul 05 02:46:55 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:55 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235.2b91ce33-d2f1-4434-863e-0966f613f5f3" returned: 0 in 0.711s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "cinder-quobyte-2b91ce33-d2f1-4434-863e-0966f613f5f3" released by "_delete_snapshot" :: held 3.292s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "cinder-quobyte-166843cd-84a6-4bfb-b484-f0ed79673235" released by "delete_snapshot" :: held 3.328s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Created reservations ['c1041c8b-0a9d-4f7f-a5f6-e3f1e9afb80f', '13cce171-67af-431a-bb51-6a5386db271a', 'a116d933-38a7-4f3b-aa4f-09e1f50ce972', '41ef07df-ecb8-4553-ac5c-cb98a46e1d61'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Delete snapshot completed successfully. Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dfd7edc7-164b-4be2-bfa9-1159b5388d21 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "cinder-2b91ce33-d2f1-4434-863e-0966f613f5f3-delete_snapshot" released by "delete_snapshot" :: held 3.495s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:56 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20" returned: 0 in 0.701s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81825ed-60de-4d56-a3bc-8f2eed80fd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc459604-7728-4f9e-b197-307169cc5b20', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a107dfe-0de0-4847-aea9-0c0c53aa9b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:56 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Volume volume-dc459604-7728-4f9e-b197-307169cc5b20 (dc459604-7728-4f9e-b197-307169cc5b20): created successfully Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a107dfe-0de0-4847-aea9-0c0c53aa9b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Flow 'volume_create_manager' (37d2920e-b63c-479c-b2df-8eb89d34de8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a5629e64-d4fb-462a-ae65-8ab3cc70b4ef tempest-VolumesListTestJSON-756633841 None] Created volume successfully. Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Acquiring lock "cinder-166843cd-84a6-4bfb-b484-f0ed79673235-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "cinder-166843cd-84a6-4bfb-b484-f0ed79673235-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Flow 'volume_create_manager' (6c3d6d12-8e51-4fd8-80f1-0415f94005f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6811df10-f182-41dc-836d-359d2b127a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Acquiring lock "cinder-quobyte-166843cd-84a6-4bfb-b484-f0ed79673235" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6811df10-f182-41dc-836d-359d2b127a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1566427628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ee7b8b-1141-4341-9ca3-5362accac7e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21e480c061a64b3888da13e760ba08b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:57Z,use_quota=True,user_id='eb5c5865bd3443efa6745135eff7db58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef16080-eb1b-49fc-b194-74acad2f0179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef16080-eb1b-49fc-b194-74acad2f0179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd66d5d-b470-4864-a933-1061e7fd3279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd66d5d-b470-4864-a933-1061e7fd3279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ee7b8b-1141-4341-9ca3-5362accac7e3', 'volume_name': 'volume-14ee7b8b-1141-4341-9ca3-5362accac7e3', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e54366-fa4d-48b6-934f-231b4e4a15d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e54366-fa4d-48b6-934f-231b4e4a15d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f682e406-8ce9-457c-9956-e58f7b4ac9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:57 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Volume 14ee7b8b-1141-4341-9ca3-5362accac7e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ee7b8b-1141-4341-9ca3-5362accac7e3', 'volume_size': 1} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1566427628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ee7b8b-1141-4341-9ca3-5362accac7e3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21e480c061a64b3888da13e760ba08b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:46:57Z,use_quota=True,user_id='eb5c5865bd3443efa6745135eff7db58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Creating volume 14ee7b8b-1141-4341-9ca3-5362accac7e3 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:46:57 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "cinder-quobyte-166843cd-84a6-4bfb-b484-f0ed79673235" acquired by "delete_volume" :: waited 0.079s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:46:57 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3 1073741824 Jul 05 02:46:57 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1ef338-9741-439e-8b08-1cc63812444a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:46:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:57 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 Jul 05 02:46:57 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:58 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3 1073741824" returned: 0 in 0.923s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:58 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235" returned: 0 in 0.886s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:58 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235 Jul 05 02:46:58 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:58 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3 Jul 05 02:46:58 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:58 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-166843cd-84a6-4bfb-b484-f0ed79673235" returned: 0 in 0.720s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:58 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3" returned: 0 in 0.706s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "cinder-quobyte-166843cd-84a6-4bfb-b484-f0ed79673235" released by "delete_volume" :: held 1.675s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f682e406-8ce9-457c-9956-e58f7b4ac9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ee7b8b-1141-4341-9ca3-5362accac7e3', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437d5dfe-d801-4d37-9dca-84f5459f6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:58 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Volume volume-14ee7b8b-1141-4341-9ca3-5362accac7e3 (14ee7b8b-1141-4341-9ca3-5362accac7e3): created successfully Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437d5dfe-d801-4d37-9dca-84f5459f6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Flow 'volume_create_manager' (6c3d6d12-8e51-4fd8-80f1-0415f94005f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:58 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0fff84da-d455-44ec-8c35-3a478466d951 tempest-VolumesListTestJSON-756633841 None] Created volume successfully. Jul 05 02:46:58 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Created reservations ['7fb230b1-0541-4ab0-a8bb-971244257227', 'b6489278-c5d7-4503-b650-dcac3ea6ca6c', 'e24c797b-3387-4f2e-8b17-21149333b38d', '3676115a-8743-4d32-94ed-94104a1802c6'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:59 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:46:59 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:46:59 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Flow 'volume_create_manager' (802bf614-c1b9-4239-ad78-82c2a529bf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224b684f-ac40-444f-9e5a-ca5c37f41693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.768s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:46:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Deleted volume successfully. Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224b684f-ac40-444f-9e5a-ca5c37f41693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1990807000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b65162-e944-4d9b-86ec-5839f9cf40f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21e480c061a64b3888da13e760ba08b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:00Z,use_quota=True,user_id='eb5c5865bd3443efa6745135eff7db58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eab100b-d9d0-4fd4-bfbf-766b6ae6cb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eab100b-d9d0-4fd4-bfbf-766b6ae6cb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975937c5-0afa-47bc-a15b-ff1ddd6bac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975937c5-0afa-47bc-a15b-ff1ddd6bac7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7b65162-e944-4d9b-86ec-5839f9cf40f9', 'volume_name': 'volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e169c315-5b97-4df2-83bf-1d31515af270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e169c315-5b97-4df2-83bf-1d31515af270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfaa7eb3-e732-49a6-85b2-62f7fced5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:46:59 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Volume f7b65162-e944-4d9b-86ec-5839f9cf40f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9', 'volume_size': 1} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1990807000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7b65162-e944-4d9b-86ec-5839f9cf40f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21e480c061a64b3888da13e760ba08b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:00Z,use_quota=True,user_id='eb5c5865bd3443efa6745135eff7db58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Creating volume f7b65162-e944-4d9b-86ec-5839f9cf40f9 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:46:59 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:46:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c152f7d3-03ea-42cf-b726-65742653eea1 tempest-SnapshotMetadataTestJSON-1556830957 None] Lock "cinder-166843cd-84a6-4bfb-b484-f0ed79673235-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:46:59 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9 1073741824 Jul 05 02:46:59 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:00 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9 1073741824" returned: 0 in 0.992s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:00 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9 Jul 05 02:47:00 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:01 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9" returned: 0 in 0.753s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:47:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfaa7eb3-e732-49a6-85b2-62f7fced5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faee7631-083c-4fee-93ff-6bb4cd0be6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:01 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Volume volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9 (f7b65162-e944-4d9b-86ec-5839f9cf40f9): created successfully Jul 05 02:47:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faee7631-083c-4fee-93ff-6bb4cd0be6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:01 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Flow 'volume_create_manager' (802bf614-c1b9-4239-ad78-82c2a529bf22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:01 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-86333a47-d737-43cb-ad26-05adf52de5d3 tempest-VolumesListTestJSON-756633841 None] Created volume successfully. Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "cinder-f7b65162-e944-4d9b-86ec-5839f9cf40f9-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-f7b65162-e944-4d9b-86ec-5839f9cf40f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "cinder-quobyte-f7b65162-e944-4d9b-86ec-5839f9cf40f9" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-quobyte-f7b65162-e944-4d9b-86ec-5839f9cf40f9" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[560ead52-0361-4201-9dc7-45421e3b3da9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:04 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9 Jul 05 02:47:04 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Flow 'volume_create_manager' (ac809f01-19ce-4679-92b2-d99474166fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4cfbab-ae01-42ab-8bb6-07241ba1e845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4cfbab-ae01-42ab-8bb6-07241ba1e845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-675024124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc27fe1e-1fda-4f38-acac-5dace38de1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fdec747f4234c21878dd9c5d7e48a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:05Z,use_quota=True,user_id='0ce027327c0e4e7687046cb614a5b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21c4e7b-7e86-4db9-a628-956ac58e69e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21c4e7b-7e86-4db9-a628-956ac58e69e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d73924e-d875-4809-b9ca-09e1a29fd258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d73924e-d875-4809-b9ca-09e1a29fd258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc27fe1e-1fda-4f38-acac-5dace38de1e7', 'volume_name': 'volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4f1fa3-a797-4b3e-8ce4-19e9788abe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4f1fa3-a797-4b3e-8ce4-19e9788abe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08274405-5b70-4371-a53e-ed5cb0272196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:04 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Volume fc27fe1e-1fda-4f38-acac-5dace38de1e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7', 'volume_size': 1} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-675024124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc27fe1e-1fda-4f38-acac-5dace38de1e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fdec747f4234c21878dd9c5d7e48a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:05Z,use_quota=True,user_id='0ce027327c0e4e7687046cb614a5b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Creating volume fc27fe1e-1fda-4f38-acac-5dace38de1e7 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:47:04 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:47:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:04 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7 1073741824 Jul 05 02:47:04 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:05 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:47:05 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:05 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9" returned: 0 in 0.871s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:05 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9 Jul 05 02:47:05 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:05 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7 1073741824" returned: 0 in 0.988s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:05 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7 Jul 05 02:47:05 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:05 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.755s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:47:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:47:06 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f7b65162-e944-4d9b-86ec-5839f9cf40f9" returned: 0 in 0.767s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-quobyte-f7b65162-e944-4d9b-86ec-5839f9cf40f9" released by "delete_volume" :: held 1.687s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Created reservations ['dfac52c6-5d0c-426d-8b9e-9ee1088f2573', 'b2bf8f38-94dd-429d-81e8-b97c24973150', 'a6b8f58b-985f-4edf-83f1-0639f1249108', '83540733-9eeb-4ead-851c-bf4cad05072b'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:06 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:47:06 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:06 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7" returned: 0 in 0.720s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08274405-5b70-4371-a53e-ed5cb0272196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6392227-451d-4083-b9fd-dd978b95a7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:06 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Volume volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7 (fc27fe1e-1fda-4f38-acac-5dace38de1e7): created successfully Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6392227-451d-4083-b9fd-dd978b95a7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Flow 'volume_create_manager' (ac809f01-19ce-4679-92b2-d99474166fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "cinder-14ee7b8b-1141-4341-9ca3-5362accac7e3-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:06 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0562f48e-d5d9-46b2-aa7e-978138e50509 tempest-VolumesTransfersTest-1948253082 None] Created volume successfully. Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-14ee7b8b-1141-4341-9ca3-5362accac7e3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "cinder-quobyte-14ee7b8b-1141-4341-9ca3-5362accac7e3" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-quobyte-14ee7b8b-1141-4341-9ca3-5362accac7e3" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c322237-9152-41cb-bb4c-b281da242f08]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:06 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3 Jul 05 02:47:06 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:07 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.708s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:07 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:47:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Deleted volume successfully. Jul 05 02:47:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cc8d3013-b412-410e-9e5c-7b0b9faccf32 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-f7b65162-e944-4d9b-86ec-5839f9cf40f9-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ba00b015-d8aa-4dcd-b9eb-21289db756dc tempest-VolumesTransfersTest-1450848901 None] Transfer volume completed successfully. Jul 05 02:47:07 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3" returned: 0 in 0.802s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:07 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3 Jul 05 02:47:07 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:08 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-14ee7b8b-1141-4341-9ca3-5362accac7e3" returned: 0 in 0.671s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-quobyte-14ee7b8b-1141-4341-9ca3-5362accac7e3" released by "delete_volume" :: held 1.532s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Created reservations ['a3739366-bc16-433e-a639-4b8f22cafcaf', 'b957757a-3412-4204-8c7b-15dee4d51f77', 'f4c72300-707e-4ed2-8dc2-2f4cb811bd46', 'b6394374-d57c-4e5c-9cc8-81cbdf17fe8c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:08 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:47:08 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Acquiring lock "cinder-fc27fe1e-1fda-4f38-acac-5dace38de1e7-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Lock "cinder-fc27fe1e-1fda-4f38-acac-5dace38de1e7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Acquiring lock "cinder-quobyte-fc27fe1e-1fda-4f38-acac-5dace38de1e7" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Lock "cinder-quobyte-fc27fe1e-1fda-4f38-acac-5dace38de1e7" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4c0d18-47e7-447b-9c7c-fc096557bfdf]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:08 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7 Jul 05 02:47:08 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "cinder-dc459604-7728-4f9e-b197-307169cc5b20-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-dc459604-7728-4f9e-b197-307169cc5b20-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "cinder-quobyte-dc459604-7728-4f9e-b197-307169cc5b20" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-quobyte-dc459604-7728-4f9e-b197-307169cc5b20" acquired by "delete_volume" :: waited 0.050s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a4beb6-d1a5-4752-aab7-883b91d2a7f2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:09 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.925s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:47:09 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Deleted volume successfully. Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3bd69565-0a05-4a43-8fd4-9ed9f5f414b2 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-14ee7b8b-1141-4341-9ca3-5362accac7e3-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:09 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20 Jul 05 02:47:09 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:09 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7" returned: 0 in 0.917s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:09 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7 Jul 05 02:47:09 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:10 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20" returned: 0 in 0.898s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:10 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20 Jul 05 02:47:10 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:10 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc27fe1e-1fda-4f38-acac-5dace38de1e7" returned: 0 in 0.778s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Lock "cinder-quobyte-fc27fe1e-1fda-4f38-acac-5dace38de1e7" released by "delete_volume" :: held 1.740s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Created reservations ['2a4aeb70-2e47-41c1-907d-a08de498a5f5', '89f5884a-3c2d-4587-8d9e-79ee7df61b8b', '6df3533b-097f-4878-a71c-78cefff2423f', 'ee2ba524-28d6-4b2c-a476-b0aa831e7df1'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:10 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:47:10 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:10 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dc459604-7728-4f9e-b197-307169cc5b20" returned: 0 in 0.717s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-quobyte-dc459604-7728-4f9e-b197-307169cc5b20" released by "delete_volume" :: held 1.668s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Created reservations ['28ce64ec-8f2e-412e-b9f1-de38523a70c1', '36ae9d1a-b4ef-4873-b069-ef891b8a554a', '4d00e207-a593-4ca1-8a2b-9dcb6c355775', '719a7ab9-ceac-4c0c-924e-d167d969a510'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:11 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:47:11 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:11 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.783s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:47:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Deleted volume successfully. Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cbe58246-7c67-4044-9c72-edefe7af0964 tempest-VolumesTransfersTest-1357535831 None] Lock "cinder-fc27fe1e-1fda-4f38-acac-5dace38de1e7-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Flow 'volume_create_manager' (97603518-f680-4039-9469-7f230ccd6965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fdcd11-761c-46a9-8ed3-997d901228a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fdcd11-761c-46a9-8ed3-997d901228a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1007869613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7642d99c-d50f-4809-ab8d-d2ede242e9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fdec747f4234c21878dd9c5d7e48a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:12Z,use_quota=True,user_id='0ce027327c0e4e7687046cb614a5b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b376bb84-5f04-48ab-980a-3bd945763e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b376bb84-5f04-48ab-980a-3bd945763e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d5ce88-23d5-4111-b7af-f125da439f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d5ce88-23d5-4111-b7af-f125da439f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7642d99c-d50f-4809-ab8d-d2ede242e9d8', 'volume_name': 'volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0812ca49-bf00-4462-99ca-c64656129a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0812ca49-bf00-4462-99ca-c64656129a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c94c39f-ecd9-4980-b960-371b8e4acc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Volume 7642d99c-d50f-4809-ab8d-d2ede242e9d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8', 'volume_size': 1} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1007869613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7642d99c-d50f-4809-ab8d-d2ede242e9d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fdec747f4234c21878dd9c5d7e48a5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:12Z,use_quota=True,user_id='0ce027327c0e4e7687046cb614a5b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Creating volume 7642d99c-d50f-4809-ab8d-d2ede242e9d8 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:47:11 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:11 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8 1073741824 Jul 05 02:47:11 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:11 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.839s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:11 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:47:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Deleted volume successfully. Jul 05 02:47:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a6bd2e47-4a8e-447b-9287-2e174a791796 tempest-VolumesListTestJSON-756633841 None] Lock "cinder-dc459604-7728-4f9e-b197-307169cc5b20-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:12 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8 1073741824" returned: 0 in 1.011s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:12 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8 Jul 05 02:47:12 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:13 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8" returned: 0 in 0.711s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c94c39f-ecd9-4980-b960-371b8e4acc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf74533-fe0b-48b8-a81a-f46b5deb640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:13 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Volume volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8 (7642d99c-d50f-4809-ab8d-d2ede242e9d8): created successfully Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf74533-fe0b-48b8-a81a-f46b5deb640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Flow 'volume_create_manager' (97603518-f680-4039-9469-7f230ccd6965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-28975017-aa35-4a7a-b757-5f0d40556e8f tempest-VolumesTransfersTest-1948253082 None] Created volume successfully. Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Flow 'volume_create_manager' (4c23694f-bbf0-4b0e-b5cf-41624fa6f11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520f0844-ca57-482f-815b-fde868c6f584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (520f0844-ca57-482f-815b-fde868c6f584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1659986868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e2f932-1f4d-488f-8fc0-83189839f9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b180b55224b38b5efe80ca99843d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:14Z,use_quota=True,user_id='e91790b23d594bd7a6cb4addf3f8a1f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadc9942-360a-4b82-b221-18cada692edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadc9942-360a-4b82-b221-18cada692edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd33986-da0d-470a-bb1c-c4b6ea7e5a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd33986-da0d-470a-bb1c-c4b6ea7e5a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e2f932-1f4d-488f-8fc0-83189839f9b7', 'volume_name': 'volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ca3580-0231-4760-9dcb-6d80251523f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ca3580-0231-4760-9dcb-6d80251523f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce939e1-5b68-4bf9-8fe5-8de3e1919c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:13 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Volume d5e2f932-1f4d-488f-8fc0-83189839f9b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7', 'volume_size': 1} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1659986868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e2f932-1f4d-488f-8fc0-83189839f9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b180b55224b38b5efe80ca99843d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:14Z,use_quota=True,user_id='e91790b23d594bd7a6cb4addf3f8a1f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Creating volume d5e2f932-1f4d-488f-8fc0-83189839f9b7 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:47:13 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:47:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:13 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 1073741824 Jul 05 02:47:13 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:14 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 1073741824" returned: 0 in 0.879s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:14 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=185,cinder:SELECT=142,cinder:INSERT=56,cinder:DELETE=16 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:47:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:14 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 Jul 05 02:47:14 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:14 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:47:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Flow 'volume_create_manager' (55ceaca5-4e61-40ee-a111-55dd6607a833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c0f447-fef1-442e-9c7f-f2311df29746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c0f447-fef1-442e-9c7f-f2311df29746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-935225857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b147ba-47f5-4311-a54e-3a5cb945000a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8119b6490a214b38956a421d1cccdbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:15Z,use_quota=True,user_id='785dfa9ed645445d8e5d14e233f8e423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013e7199-c2cc-4645-a491-c3c63186b5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013e7199-c2cc-4645-a491-c3c63186b5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961331d6-7d49-411d-81f6-fc4171d09dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961331d6-7d49-411d-81f6-fc4171d09dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b147ba-47f5-4311-a54e-3a5cb945000a', 'volume_name': 'volume-33b147ba-47f5-4311-a54e-3a5cb945000a', 'volume_size': 2}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbd3a45-f986-4d71-ac14-df27cb7d9200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbd3a45-f986-4d71-ac14-df27cb7d9200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b01a1f9-ba23-404e-918c-7bc31eae2b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:15 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Volume 33b147ba-47f5-4311-a54e-3a5cb945000a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b147ba-47f5-4311-a54e-3a5cb945000a', 'volume_size': 2} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Acquiring lock "cinder-7642d99c-d50f-4809-ab8d-d2ede242e9d8-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Lock "cinder-7642d99c-d50f-4809-ab8d-d2ede242e9d8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Acquiring lock "cinder-quobyte-7642d99c-d50f-4809-ab8d-d2ede242e9d8" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Lock "cinder-quobyte-7642d99c-d50f-4809-ab8d-d2ede242e9d8" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1892c13-f2c2-4842-bb23-5715d2b927bf]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:15 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8 Jul 05 02:47:15 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:15 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7" returned: 0 in 0.660s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.411s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-935225857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b147ba-47f5-4311-a54e-3a5cb945000a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8119b6490a214b38956a421d1cccdbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:15Z,use_quota=True,user_id='785dfa9ed645445d8e5d14e233f8e423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Creating volume 33b147ba-47f5-4311-a54e-3a5cb945000a {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:47:15 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a 2147483648 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce939e1-5b68-4bf9-8fe5-8de3e1919c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:15 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a 2147483648 Jul 05 02:47:15 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f55ee57-0894-4660-9ed8-d0be1053405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:15 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Volume volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 (d5e2f932-1f4d-488f-8fc0-83189839f9b7): created successfully Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f55ee57-0894-4660-9ed8-d0be1053405c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Flow 'volume_create_manager' (4c23694f-bbf0-4b0e-b5cf-41624fa6f11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:15 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5193044b-60b1-4c00-a8fe-537364aa3bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Created volume successfully. Jul 05 02:47:16 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8" returned: 0 in 0.814s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:16 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8 Jul 05 02:47:16 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:16 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a 2147483648" returned: 0 in 0.935s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:16 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a Jul 05 02:47:16 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:16 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7642d99c-d50f-4809-ab8d-d2ede242e9d8" returned: 0 in 0.689s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Lock "cinder-quobyte-7642d99c-d50f-4809-ab8d-d2ede242e9d8" released by "delete_volume" :: held 1.547s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Created reservations ['cd0092e9-b210-4dcf-9e13-da5812368b07', 'ede9f51b-3a9f-4297-a713-2f61ed8b9875', 'b58a1e25-4279-4cc6-85ef-afc31edf211a', '8a7e93ab-6354-44ce-ac0c-7eb2f73c1d8b'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:16 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:47:16 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:17 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a" returned: 0 in 0.666s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.024s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Creating offline snapshot cf803582-408c-4236-8f49-79f8fa896411 of volume d5e2f932-1f4d-488f-8fc0-83189839f9b7 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b01a1f9-ba23-404e-918c-7bc31eae2b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b147ba-47f5-4311-a54e-3a5cb945000a', 'volume_size': 2}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140ebf1d-27cb-4d7c-88ad-d3f72817e4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[67383c84-3a2b-4cb0-8bfb-94e259f260ce]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:17 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Volume volume-33b147ba-47f5-4311-a54e-3a5cb945000a (33b147ba-47f5-4311-a54e-3a5cb945000a): created successfully Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140ebf1d-27cb-4d7c-88ad-d3f72817e4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Flow 'volume_create_manager' (55ceaca5-4e61-40ee-a111-55dd6607a833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:17 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3325889d-f00f-4c63-81e1-5aca94fb363a tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Created volume successfully. Jul 05 02:47:17 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 Jul 05 02:47:17 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:17 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.726s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:47:17 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Deleted volume successfully. Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-88af83b4-9968-4eeb-8a02-1c2af41167e4 tempest-VolumesTransfersTest-1357535831 None] Lock "cinder-7642d99c-d50f-4809-ab8d-d2ede242e9d8-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:17 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7" returned: 0 in 0.794s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:17 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 1G Jul 05 02:47:17 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:18 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=204,cinder:SELECT=150,cinder:INSERT=48,cinder:DELETE=14 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:47:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:18 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 1G" returned: 0 in 0.879s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:18 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 Jul 05 02:47:18 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:19 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411" returned: 0 in 0.767s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:19 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 is being set with open permissions: ugo+rw Jul 05 02:47:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:19 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 Jul 05 02:47:19 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:20 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411" returned: 0 in 0.680s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:20 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.info Jul 05 02:47:20 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:21 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.info" returned: 0 in 0.686s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:21 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.info is being set with open permissions: ugo+rw Jul 05 02:47:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:21 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.info Jul 05 02:47:21 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:21 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.info" returned: 0 in 0.653s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.577s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.407s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Creating offline snapshot a67ac6fd-e927-4d1e-87c5-6fc01558d08d of volume 33b147ba-47f5-4311-a54e-3a5cb945000a {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:47:21 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b422d63f-8381-4360-8e48-1401dcd34bfc]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c77055cf-b8c0-42e9-a268-57ab98173477 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Create snapshot completed successfully Jul 05 02:47:21 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a Jul 05 02:47:21 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:22 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a" returned: 0 in 0.804s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d 2G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:22 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d 2G Jul 05 02:47:22 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Acquiring lock "cinder-cf803582-408c-4236-8f49-79f8fa896411-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "cinder-cf803582-408c-4236-8f49-79f8fa896411-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Acquiring lock "cinder-quobyte-d5e2f932-1f4d-488f-8fc0-83189839f9b7" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "cinder-quobyte-d5e2f932-1f4d-488f-8fc0-83189839f9b7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Acquiring lock "cinder-quobyte-cf803582-408c-4236-8f49-79f8fa896411" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "cinder-quobyte-cf803582-408c-4236-8f49-79f8fa896411" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Deleting offline snapshot cf803582-408c-4236-8f49-79f8fa896411 of volume d5e2f932-1f4d-488f-8fc0-83189839f9b7 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] snapshot_file for this snap is: volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ada2cc7-e8bc-4a33-ae45-32d789863363]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:23 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 Jul 05 02:47:23 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:23 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d 2G" returned: 0 in 0.961s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b147ba-47f5-4311-a54e-3a5cb945000a -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:23 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b147ba-47f5-4311-a54e-3a5cb945000a -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d Jul 05 02:47:23 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:23 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411" returned: 0 in 0.846s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:47:23 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b349499-518b-4ec1-8178-83a165e4cab5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:23 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 Jul 05 02:47:23 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:24 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b147ba-47f5-4311-a54e-3a5cb945000a -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d" returned: 0 in 0.784s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:24 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d is being set with open permissions: ugo+rw Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:24 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d Jul 05 02:47:24 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Flow 'volume_create_manager' (89e6c950-7ae7-4a54-bf97-4ae5bd3e3425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e03af0-4787-4923-81c9-8c664c4fc41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e03af0-4787-4923-81c9-8c664c4fc41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-918765838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe94dfb-44e6-4104-9b70-54805ad81800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14e86958ebf428ea30466521f78e9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:24Z,use_quota=True,user_id='2fbc9571af03449e9f6c9461815035f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (decb4a20-44af-4d02-8ccd-d7af64e20794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (decb4a20-44af-4d02-8ccd-d7af64e20794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d74d8df-01ec-4482-9402-93ff43e25e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d74d8df-01ec-4482-9402-93ff43e25e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe94dfb-44e6-4104-9b70-54805ad81800', 'volume_name': 'volume-6fe94dfb-44e6-4104-9b70-54805ad81800', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2655a3-8d61-4132-9f7f-6fc11bad0f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2655a3-8d61-4132-9f7f-6fc11bad0f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab7314a-338c-459d-bc36-15892a32e1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:24 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Volume 6fe94dfb-44e6-4104-9b70-54805ad81800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe94dfb-44e6-4104-9b70-54805ad81800', 'volume_size': 1} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:24 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7" returned: 0 in 0.812s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:24 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 Jul 05 02:47:24 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:24 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d" returned: 0 in 0.657s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:25 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.info Jul 05 02:47:25 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:25 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411" returned: 0 in 0.753s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:25 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411 Jul 05 02:47:25 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:25 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.info" returned: 0 in 0.654s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:25 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.info is being set with open permissions: ugo+rw Jul 05 02:47:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:25 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.info Jul 05 02:47:25 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:26 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7.cf803582-408c-4236-8f49-79f8fa896411" returned: 0 in 0.643s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "cinder-quobyte-cf803582-408c-4236-8f49-79f8fa896411" released by "_delete_snapshot" :: held 3.185s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "cinder-quobyte-d5e2f932-1f4d-488f-8fc0-83189839f9b7" released by "delete_snapshot" :: held 3.213s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Created reservations ['90502758-bf84-4e30-a9e6-282b11150b09', 'cdd4dc06-17f5-454a-a301-e5c69e25f52c', '39aeb944-2d53-4447-87c2-62139bc890b1', '6fe8b99e-d2d5-4585-8717-acca96af467c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Delete snapshot completed successfully. Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-72d6887a-94dd-420d-868f-4561b25ccdf7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "cinder-cf803582-408c-4236-8f49-79f8fa896411-delete_snapshot" released by "delete_snapshot" :: held 3.349s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:26 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.info" returned: 0 in 0.634s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.595s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.889s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-918765838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe94dfb-44e6-4104-9b70-54805ad81800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14e86958ebf428ea30466521f78e9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:24Z,use_quota=True,user_id='2fbc9571af03449e9f6c9461815035f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Creating volume 6fe94dfb-44e6-4104-9b70-54805ad81800 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:47:26 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:26 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800 1073741824 Jul 05 02:47:26 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-427d0f59-21b8-4c54-ace7-6ed0dd381a1f tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Create snapshot completed successfully Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Acquiring lock "cinder-a67ac6fd-e927-4d1e-87c5-6fc01558d08d-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "cinder-a67ac6fd-e927-4d1e-87c5-6fc01558d08d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Acquiring lock "cinder-quobyte-33b147ba-47f5-4311-a54e-3a5cb945000a" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "cinder-quobyte-33b147ba-47f5-4311-a54e-3a5cb945000a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Acquiring lock "cinder-quobyte-a67ac6fd-e927-4d1e-87c5-6fc01558d08d" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "cinder-quobyte-a67ac6fd-e927-4d1e-87c5-6fc01558d08d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Deleting offline snapshot a67ac6fd-e927-4d1e-87c5-6fc01558d08d of volume 33b147ba-47f5-4311-a54e-3a5cb945000a {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] snapshot_file for this snap is: volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f8a77f-6e14-488e-9044-e16c0e3b2567]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:26 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d Jul 05 02:47:26 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Acquiring lock "cinder-d5e2f932-1f4d-488f-8fc0-83189839f9b7-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "cinder-d5e2f932-1f4d-488f-8fc0-83189839f9b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:27 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800 1073741824" returned: 0 in 0.827s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Acquiring lock "cinder-quobyte-d5e2f932-1f4d-488f-8fc0-83189839f9b7" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "cinder-quobyte-d5e2f932-1f4d-488f-8fc0-83189839f9b7" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:27 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800 Jul 05 02:47:27 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[636a962d-ecea-4db5-9325-acc4707bf7cd]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:27 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 Jul 05 02:47:27 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:27 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d" returned: 0 in 0.816s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b147ba-47f5-4311-a54e-3a5cb945000a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[779c5705-ac5a-4519-a804-ce7ebbe92bc8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:27 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a Jul 05 02:47:27 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:27 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800" returned: 0 in 0.679s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab7314a-338c-459d-bc36-15892a32e1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe94dfb-44e6-4104-9b70-54805ad81800', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1db2b4-f19f-4349-9539-eb0a10511f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:27 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Volume volume-6fe94dfb-44e6-4104-9b70-54805ad81800 (6fe94dfb-44e6-4104-9b70-54805ad81800): created successfully Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1db2b4-f19f-4349-9539-eb0a10511f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Flow 'volume_create_manager' (89e6c950-7ae7-4a54-bf97-4ae5bd3e3425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5d63f957-a458-4912-b848-be49e0ae41ef tempest-VolumesTransfersV357Test-743673443 None] Created volume successfully. Jul 05 02:47:28 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7" returned: 0 in 0.816s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:28 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7 Jul 05 02:47:28 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:28 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a" returned: 0 in 0.807s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:28 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d Jul 05 02:47:28 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:28 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d5e2f932-1f4d-488f-8fc0-83189839f9b7" returned: 0 in 0.666s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "cinder-quobyte-d5e2f932-1f4d-488f-8fc0-83189839f9b7" released by "delete_volume" :: held 1.551s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Created reservations ['7eb7474f-f86e-4b5d-b9a9-d1409788367c', '5d74db9d-a909-460b-9202-682ac37aaad5', 'cd3c12e8-1aaf-4438-84cb-d72c191c4167', 'b06b4189-49ee-4439-9e6a-40fb46f41503'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:28 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:47:28 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0a5da3f5-401d-470b-ba88-1bb6c3659656 tempest-VolumesTransfersV357Test-2132147917 None] Transfer volume completed successfully. Jul 05 02:47:29 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d" returned: 0 in 0.771s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:29 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d Jul 05 02:47:29 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:29 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.669s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:29 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:47:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Deleted volume successfully. Jul 05 02:47:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b746a0a2-bece-48be-aa4a-c05128f4bd66 tempest-VolumeSnapshotQuotasNegativeTestJSON-2032258254 None] Lock "cinder-d5e2f932-1f4d-488f-8fc0-83189839f9b7-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:29 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a.a67ac6fd-e927-4d1e-87c5-6fc01558d08d" returned: 0 in 0.688s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "cinder-quobyte-a67ac6fd-e927-4d1e-87c5-6fc01558d08d" released by "_delete_snapshot" :: held 3.191s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "cinder-quobyte-33b147ba-47f5-4311-a54e-3a5cb945000a" released by "delete_snapshot" :: held 3.217s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:30 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Created reservations ['ca03c30d-750f-4a6e-a757-f3443d096936', 'df081a9f-3089-46ac-9b97-d175d08c450c', '89e63788-e4c7-440b-9a69-c4a194b299a9', '6f14df73-db47-47a5-bcdc-ad39b449309f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:30 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Delete snapshot completed successfully. Jul 05 02:47:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84a7b148-d3e2-4b39-a019-9860414a0c8c tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "cinder-a67ac6fd-e927-4d1e-87c5-6fc01558d08d-delete_snapshot" released by "delete_snapshot" :: held 3.387s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Acquiring lock "cinder-6fe94dfb-44e6-4104-9b70-54805ad81800-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Lock "cinder-6fe94dfb-44e6-4104-9b70-54805ad81800-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Acquiring lock "cinder-quobyte-6fe94dfb-44e6-4104-9b70-54805ad81800" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Lock "cinder-quobyte-6fe94dfb-44e6-4104-9b70-54805ad81800" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:30 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68a3043-66d9-425b-a8f0-f1a8605fc10c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:30 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800 Jul 05 02:47:30 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Acquiring lock "cinder-33b147ba-47f5-4311-a54e-3a5cb945000a-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "cinder-33b147ba-47f5-4311-a54e-3a5cb945000a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Acquiring lock "cinder-quobyte-33b147ba-47f5-4311-a54e-3a5cb945000a" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "cinder-quobyte-33b147ba-47f5-4311-a54e-3a5cb945000a" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fce275-37f1-40e1-a155-a3e5ecc347b0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:31 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a Jul 05 02:47:31 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:31 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800" returned: 0 in 0.881s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:31 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800 Jul 05 02:47:31 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:32 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a" returned: 0 in 0.837s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:32 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6fe94dfb-44e6-4104-9b70-54805ad81800" returned: 0 in 0.732s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Lock "cinder-quobyte-6fe94dfb-44e6-4104-9b70-54805ad81800" released by "delete_volume" :: held 1.670s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:32 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a Jul 05 02:47:32 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Created reservations ['2c8d2df6-1cfb-4596-a53b-1e1cea74b1e4', 'd5bd221a-04b0-4be8-9106-e4055b02c7ff', '98e66369-1179-4c44-b9e6-9f1bd9c410ab', 'd2547254-7a02-4a18-9665-9bb6e3ad10dd'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:32 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:47:32 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:32 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-33b147ba-47f5-4311-a54e-3a5cb945000a" returned: 0 in 0.741s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "cinder-quobyte-33b147ba-47f5-4311-a54e-3a5cb945000a" released by "delete_volume" :: held 1.658s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:32 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Created reservations ['d8017ea5-08a2-40d4-b1db-4d1ef0368df5', '79ccfb2f-e709-42f4-ae39-546f6c09d920', 'c0ea35cc-3496-4e74-8244-c6f0340b2a0b', 'fb3c1e80-4aab-4041-bcc3-ef10bebc629f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:33 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.764s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Deleted volume successfully. Jul 05 02:47:33 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:47:33 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2e2c57e7-2e62-47b1-b181-b8566f6f9654 tempest-VolumesTransfersV357Test-529362747 None] Lock "cinder-6fe94dfb-44e6-4104-9b70-54805ad81800-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Flow 'volume_create_manager' (dcd501ae-abe1-4ad3-8a61-2a6a9235537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde13a57-8c15-4e64-8118-f599bd94a51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde13a57-8c15-4e64-8118-f599bd94a51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1545865549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe430dd9-018c-439d-b915-96acda7933c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14e86958ebf428ea30466521f78e9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:33Z,use_quota=True,user_id='2fbc9571af03449e9f6c9461815035f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92de1b7d-abaa-4f62-8755-62b4d1c036db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92de1b7d-abaa-4f62-8755-62b4d1c036db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e1083c-7706-471f-8543-a714732fa417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e1083c-7706-471f-8543-a714732fa417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe430dd9-018c-439d-b915-96acda7933c5', 'volume_name': 'volume-fe430dd9-018c-439d-b915-96acda7933c5', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c07c46a-8ff9-4615-8d55-bf953eece1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c07c46a-8ff9-4615-8d55-bf953eece1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594b7fa9-63cd-4e9f-bd2f-20b680b91538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:33 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Volume fe430dd9-018c-439d-b915-96acda7933c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe430dd9-018c-439d-b915-96acda7933c5', 'volume_size': 1} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1545865549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe430dd9-018c-439d-b915-96acda7933c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f14e86958ebf428ea30466521f78e9a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:47:33Z,use_quota=True,user_id='2fbc9571af03449e9f6c9461815035f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Creating volume fe430dd9-018c-439d-b915-96acda7933c5 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:47:33 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:33 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5 1073741824 Jul 05 02:47:33 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:33 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.704s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:47:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Deleted volume successfully. Jul 05 02:47:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-77b7be45-d7f1-4f50-ba66-275890d43456 tempest-VolumesSnapshotNegativeTestJSON-2107644900 None] Lock "cinder-33b147ba-47f5-4311-a54e-3a5cb945000a-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:34 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5 1073741824" returned: 0 in 1.018s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:34 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5 Jul 05 02:47:34 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:35 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5" returned: 0 in 0.740s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:47:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594b7fa9-63cd-4e9f-bd2f-20b680b91538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe430dd9-018c-439d-b915-96acda7933c5', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93155f17-f04a-4b56-97ac-21a6e1c49cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:47:35 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Volume volume-fe430dd9-018c-439d-b915-96acda7933c5 (fe430dd9-018c-439d-b915-96acda7933c5): created successfully Jul 05 02:47:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93155f17-f04a-4b56-97ac-21a6e1c49cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:47:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Flow 'volume_create_manager' (dcd501ae-abe1-4ad3-8a61-2a6a9235537e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:47:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-45f0a058-5d74-47ca-a226-92553cf22c70 tempest-VolumesTransfersV357Test-743673443 None] Created volume successfully. Jul 05 02:47:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Acquiring lock "cinder-fe430dd9-018c-439d-b915-96acda7933c5-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Lock "cinder-fe430dd9-018c-439d-b915-96acda7933c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Acquiring lock "cinder-quobyte-fe430dd9-018c-439d-b915-96acda7933c5" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:47:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Lock "cinder-quobyte-fe430dd9-018c-439d-b915-96acda7933c5" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:47:36 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97fa259-eee0-471b-8af5-a6e6832edddb]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:47:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:37 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5 Jul 05 02:47:37 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:37 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5" returned: 0 in 0.926s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:37 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5 Jul 05 02:47:37 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:38 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fe430dd9-018c-439d-b915-96acda7933c5" returned: 0 in 0.735s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Lock "cinder-quobyte-fe430dd9-018c-439d-b915-96acda7933c5" released by "delete_volume" :: held 1.730s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:38 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Created reservations ['3c54ff97-8750-4c92-b051-ae0650260ee4', '2b11efa5-c678-4d22-858c-1e40a9e72d98', '0ea3821f-ae51-4b8d-9b9a-5e42576e5602', '51e6f862-48d8-45de-964c-8863d800362e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:47:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:47:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:47:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:47:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:47:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:47:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:47:38 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:47:38 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:47:39 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jul 05 02:47:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.793s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:47:39 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:47:39 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Deleted volume successfully. Jul 05 02:47:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-641c902c-193f-43a5-826a-41edf89d2976 tempest-VolumesTransfersV357Test-529362747 None] Lock "cinder-fe430dd9-018c-439d-b915-96acda7933c5-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:47:48 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=45,cinder:UPDATE=52,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:47:49 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=44,cinder:UPDATE=62,cinder:DELETE=7,cinder:INSERT=20 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Flow 'volume_create_manager' (d50b0fbd-0ebd-455d-8e46-58faccc68971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af45a2c-fa48-4fb1-b724-81dd27be90ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af45a2c-fa48-4fb1-b724-81dd27be90ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1141111734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d888a3e-bd8d-4534-b102-8c7526aaa379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a253be15f83b4ec1ac375fc88fbaa23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:02Z,use_quota=True,user_id='416bd77273d648128d6f0f603c9ebe32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c235e3-cb7d-4e7d-b35c-ed8075a19558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c235e3-cb7d-4e7d-b35c-ed8075a19558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1c2b86-15d6-4b34-8c4a-3c82a91ec04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1c2b86-15d6-4b34-8c4a-3c82a91ec04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d888a3e-bd8d-4534-b102-8c7526aaa379', 'volume_name': 'volume-3d888a3e-bd8d-4534-b102-8c7526aaa379', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0d9a31-bc72-430d-8061-d2e0fcde5d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0d9a31-bc72-430d-8061-d2e0fcde5d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f19266-340f-4a87-a21e-eee826455675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:02 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Volume 3d888a3e-bd8d-4534-b102-8c7526aaa379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d888a3e-bd8d-4534-b102-8c7526aaa379', 'volume_size': 1} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1141111734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d888a3e-bd8d-4534-b102-8c7526aaa379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a253be15f83b4ec1ac375fc88fbaa23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:02Z,use_quota=True,user_id='416bd77273d648128d6f0f603c9ebe32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Creating volume 3d888a3e-bd8d-4534-b102-8c7526aaa379 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:48:02 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:48:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:02 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 1073741824 Jul 05 02:48:02 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:03 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 1073741824" returned: 0 in 1.059s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:03 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 Jul 05 02:48:03 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:04 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379" returned: 0 in 0.763s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f19266-340f-4a87-a21e-eee826455675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d888a3e-bd8d-4534-b102-8c7526aaa379', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6d9f94-e3b3-4eb6-8c8f-76792fe43528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:04 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Volume volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 (3d888a3e-bd8d-4534-b102-8c7526aaa379): created successfully Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6d9f94-e3b3-4eb6-8c8f-76792fe43528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Flow 'volume_create_manager' (d50b0fbd-0ebd-455d-8e46-58faccc68971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:04 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9de782d1-803f-4b0f-b8c3-06ccd0c6597a tempest-VolumesActionsTest-623115873 None] Created volume successfully. Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Flow 'volume_create_manager' (7eab08f3-d068-4be0-9680-f80e3e7a07c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef99d9e-982f-455a-aa86-93f0eb807d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef99d9e-982f-455a-aa86-93f0eb807d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-133417514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1276a8d8-08e4-49bf-8499-7bddc43b31de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70077d1d44948708fc06e9fba45a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:05Z,use_quota=True,user_id='2552acfcad0b4cccb242d3bbbe37b649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f347528-aa44-4111-be02-1d8361feb53f),volume_type_id=5f347528-aa44-4111-be02-1d8361feb53f)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41a9eeb-4083-4c90-867b-d455f1e17c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41a9eeb-4083-4c90-867b-d455f1e17c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c76d172-b968-4a35-b801-531fd36c087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c76d172-b968-4a35-b801-531fd36c087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1276a8d8-08e4-49bf-8499-7bddc43b31de', 'volume_name': 'volume-1276a8d8-08e4-49bf-8499-7bddc43b31de', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6534df-94ff-4110-ab2f-5429a833d4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6534df-94ff-4110-ab2f-5429a833d4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74333ea9-f576-4fd2-8342-7f767fa39ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:04 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Volume 1276a8d8-08e4-49bf-8499-7bddc43b31de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1276a8d8-08e4-49bf-8499-7bddc43b31de', 'volume_size': 1} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-133417514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1276a8d8-08e4-49bf-8499-7bddc43b31de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70077d1d44948708fc06e9fba45a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:05Z,use_quota=True,user_id='2552acfcad0b4cccb242d3bbbe37b649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f347528-aa44-4111-be02-1d8361feb53f),volume_type_id=5f347528-aa44-4111-be02-1d8361feb53f)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Creating volume 1276a8d8-08e4-49bf-8499-7bddc43b31de {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:48:04 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:48:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:04 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de 1073741824 Jul 05 02:48:04 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:05 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:48:05 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Flow 'volume_create_manager' (e551cac7-66d6-4b95-8f4d-7f134163d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e387559-b8e7-41ad-8c3d-4bdb808b4805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e387559-b8e7-41ad-8c3d-4bdb808b4805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-966534536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d500cedc-da37-4273-9fe3-f267617f7f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70077d1d44948708fc06e9fba45a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:05Z,use_quota=True,user_id='2552acfcad0b4cccb242d3bbbe37b649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c621b4-f957-43db-ae7a-72192372cdd7),volume_type_id=47c621b4-f957-43db-ae7a-72192372cdd7)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff7d42c-a1f6-4765-b7ff-3ef23e70f13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff7d42c-a1f6-4765-b7ff-3ef23e70f13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a7f3a5-972c-44e1-9cf5-74aadd19de50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a7f3a5-972c-44e1-9cf5-74aadd19de50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd500cedc-da37-4273-9fe3-f267617f7f21', 'volume_name': 'volume-d500cedc-da37-4273-9fe3-f267617f7f21', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee9f985-6712-4a67-b834-6f404cb3a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee9f985-6712-4a67-b834-6f404cb3a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912a89a6-15f5-482b-bd52-8d23abd4a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:05 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Volume d500cedc-da37-4273-9fe3-f267617f7f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d500cedc-da37-4273-9fe3-f267617f7f21', 'volume_size': 1} Jul 05 02:48:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:06 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de 1073741824" returned: 0 in 1.346s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:06 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.072s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:06 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de Jul 05 02:48:06 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Flow 'volume_create_manager' (1f8e3d26-862a-464e-b9c6-73549eadfd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061696b6-b50e-4e76-add5-cba41a52d894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061696b6-b50e-4e76-add5-cba41a52d894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-264150932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba99be1c-7b96-4086-a59d-23d3267f528f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70077d1d44948708fc06e9fba45a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:06Z,use_quota=True,user_id='2552acfcad0b4cccb242d3bbbe37b649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5aa5411-7e9d-421d-ad00-1ecdad1b55e5),volume_type_id=a5aa5411-7e9d-421d-ad00-1ecdad1b55e5)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b956669-2ae6-4def-84d6-77d43d36c137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b956669-2ae6-4def-84d6-77d43d36c137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e917f5fd-812b-4e16-9389-9ecee705ec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.image.glance [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Creating Keystone auth plugin from conf {{(pid=86671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e917f5fd-812b-4e16-9389-9ecee705ec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba99be1c-7b96-4086-a59d-23d3267f528f', 'volume_name': 'volume-ba99be1c-7b96-4086-a59d-23d3267f528f', 'volume_size': 1, 'image_id': '2355e59a-c6a0-4067-970e-727dd63c6306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2355e59a-c6a0-4067-970e-727dd63c6306', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--971302400', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b70077d1d44948708fc06e9fba45a675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2355e59a-c6a0-4067-970e-727dd63c6306', 'created_at': datetime.datetime(2026, 7, 5, 0, 48, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2355e59a-c6a0-4067-970e-727dd63c6306/file', 'properties': {}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25847691-0c71-4d57-93ed-61a9bdfe3cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25847691-0c71-4d57-93ed-61a9bdfe3cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94804d4f-2fef-4800-bbaa-d7dfab29bf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:06 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Volume ba99be1c-7b96-4086-a59d-23d3267f528f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba99be1c-7b96-4086-a59d-23d3267f528f', 'volume_size': 1, 'image_id': '2355e59a-c6a0-4067-970e-727dd63c6306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2355e59a-c6a0-4067-970e-727dd63c6306', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--971302400', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b70077d1d44948708fc06e9fba45a675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2355e59a-c6a0-4067-970e-727dd63c6306', 'created_at': datetime.datetime(2026, 7, 5, 0, 48, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2355e59a-c6a0-4067-970e-727dd63c6306/file', 'properties': {}}, 'image_service': } Jul 05 02:48:06 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Trying to clone ba99be1c-7b96-4086-a59d-23d3267f528f from image 2355e59a-c6a0-4067-970e-727dd63c6306 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2355e59a-c6a0-4067-970e-727dd63c6306', 'metadata': {}}]). {{(pid=86671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 05 02:48:07 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de" returned: 0 in 1.051s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.467s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.923s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-966534536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d500cedc-da37-4273-9fe3-f267617f7f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70077d1d44948708fc06e9fba45a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:05Z,use_quota=True,user_id='2552acfcad0b4cccb242d3bbbe37b649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c621b4-f957-43db-ae7a-72192372cdd7),volume_type_id=47c621b4-f957-43db-ae7a-72192372cdd7)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Creating volume d500cedc-da37-4273-9fe3-f267617f7f21 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:48:07 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74333ea9-f576-4fd2-8342-7f767fa39ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1276a8d8-08e4-49bf-8499-7bddc43b31de', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12710c1e-638d-43a0-bf75-a769932f5823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:07 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 1073741824 Jul 05 02:48:07 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:07 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Volume volume-1276a8d8-08e4-49bf-8499-7bddc43b31de (1276a8d8-08e4-49bf-8499-7bddc43b31de): created successfully Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12710c1e-638d-43a0-bf75-a769932f5823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Flow 'volume_create_manager' (7eab08f3-d068-4be0-9680-f80e3e7a07c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-43180a10-5661-41a2-a68f-ca345449332d tempest-TestInstancesWithCinderVolumes-1617454047 None] Created volume successfully. Jul 05 02:48:08 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 1073741824" returned: 0 in 1.387s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:08 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 Jul 05 02:48:08 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:09 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21" returned: 0 in 0.831s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:48:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912a89a6-15f5-482b-bd52-8d23abd4a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d500cedc-da37-4273-9fe3-f267617f7f21', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07657ef8-c8ef-44c3-9841-1fdbaafd688e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:09 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Volume volume-d500cedc-da37-4273-9fe3-f267617f7f21 (d500cedc-da37-4273-9fe3-f267617f7f21): created successfully Jul 05 02:48:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07657ef8-c8ef-44c3-9841-1fdbaafd688e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Flow 'volume_create_manager' (e551cac7-66d6-4b95-8f4d-7f134163d99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:09 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3e524f0f-56ab-4380-afee-1f21e2c65295 tempest-TestInstancesWithCinderVolumes-1617454047 None] Created volume successfully. Jul 05 02:48:11 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD, size 20.69 MB, duration 4.56 sec {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 02:48:11 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Image download 20.69 MB at 4.54 MB/s Jul 05 02:48:11 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[933e446f-8c81-42fd-97b6-54e89c36b883]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:48:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:11 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD Jul 05 02:48:11 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:12 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD" returned: 0 in 0.767s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:12 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Temporary image 2355e59a-c6a0-4067-970e-727dd63c6306 is fetched for user 2552acfcad0b4cccb242d3bbbe37b649. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 02:48:12 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0adb29-fe42-498c-be9b-6470c52b13cf]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:48:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:12 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD Jul 05 02:48:12 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:13 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD" returned: 0 in 0.788s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-264150932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba99be1c-7b96-4086-a59d-23d3267f528f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70077d1d44948708fc06e9fba45a675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:06Z,use_quota=True,user_id='2552acfcad0b4cccb242d3bbbe37b649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5aa5411-7e9d-421d-ad00-1ecdad1b55e5),volume_type_id=a5aa5411-7e9d-421d-ad00-1ecdad1b55e5)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Creating volume ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:48:13 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:48:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:13 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f 1073741824 Jul 05 02:48:13 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:14 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f 1073741824" returned: 0 in 1.012s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:14 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f Jul 05 02:48:14 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:15 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f" returned: 0 in 0.830s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:48:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:15 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Attempting download of 2355e59a-c6a0-4067-970e-727dd63c6306 ((None, [{'url': 'file:///opt/stack/data/glance/images/2355e59a-c6a0-4067-970e-727dd63c6306', 'metadata': {}}])) to volume ba99be1c-7b96-4086-a59d-23d3267f528f. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 02:48:15 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c96ac39-e12a-42ad-98de-5f0167504bb8]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:48:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2355e59a-c6a0-4067-970e-727dd63c6306_u1b9dmpm {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:15 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2355e59a-c6a0-4067-970e-727dd63c6306_u1b9dmpm Jul 05 02:48:15 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:16 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2355e59a-c6a0-4067-970e-727dd63c6306_u1b9dmpm" returned: 0 in 0.969s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2355e59a-c6a0-4067-970e-727dd63c6306_u1b9dmpm {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:16 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2355e59a-c6a0-4067-970e-727dd63c6306_u1b9dmpm Jul 05 02:48:16 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:16 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2355e59a-c6a0-4067-970e-727dd63c6306_u1b9dmpm" returned: 1 in 0.800s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2355e59a-c6a0-4067-970e-727dd63c6306_u1b9dmpm' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:48:16 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f66ec23-5238-401b-87ca-66d5dd7b819c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:48:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:17 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD Jul 05 02:48:17 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:17 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD" returned: 0 in 0.849s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:17 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] 2355e59a-c6a0-4067-970e-727dd63c6306 was qcow2, converting to raw {{(pid=86671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 02:48:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:17 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f Jul 05 02:48:17 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:20 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f" returned: 0 in 2.525s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:20 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2355e59a-c6a0-4067-970e-727dd63c6306_dav4uyd3devstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:48:20 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Converted 112.00 MB image at 44.34 MB/s Jul 05 02:48:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:20 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f 1G Jul 05 02:48:20 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:21 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f 1G" returned: 0 in 0.829s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:21 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd7cf5d-8b72-4d4a-8f89-9d56bb21326f]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:48:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:21 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f Jul 05 02:48:21 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:22 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f" returned: 0 in 0.844s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:22 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f Jul 05 02:48:22 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:23 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f" returned: 1 in 0.948s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Downloaded image 2355e59a-c6a0-4067-970e-727dd63c6306 ((None, [{'url': 'file:///opt/stack/data/glance/images/2355e59a-c6a0-4067-970e-727dd63c6306', 'metadata': {}}])) to volume ba99be1c-7b96-4086-a59d-23d3267f528f successfully. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Temporary image 2355e59a-c6a0-4067-970e-727dd63c6306 for user 2552acfcad0b4cccb242d3bbbe37b649 is deleted. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Marking volume ba99be1c-7b96-4086-a59d-23d3267f528f as bootable. {{(pid=86671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Copying metadata from image 2355e59a-c6a0-4067-970e-727dd63c6306 to ba99be1c-7b96-4086-a59d-23d3267f528f. {{(pid=86671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Creating volume glance metadata for volume ba99be1c-7b96-4086-a59d-23d3267f528f backed by image 2355e59a-c6a0-4067-970e-727dd63c6306 with: {'image_id': '2355e59a-c6a0-4067-970e-727dd63c6306', 'image_name': 'tempest-scenario-img--971302400', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94804d4f-2fef-4800-bbaa-d7dfab29bf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba99be1c-7b96-4086-a59d-23d3267f528f', 'volume_size': 1, 'image_id': '2355e59a-c6a0-4067-970e-727dd63c6306', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2355e59a-c6a0-4067-970e-727dd63c6306', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--971302400', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b70077d1d44948708fc06e9fba45a675', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2355e59a-c6a0-4067-970e-727dd63c6306', 'created_at': datetime.datetime(2026, 7, 5, 0, 48, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2355e59a-c6a0-4067-970e-727dd63c6306/file', 'properties': {}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9f78b9-4382-455c-a452-86cb9d9f0856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:23 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Volume volume-ba99be1c-7b96-4086-a59d-23d3267f528f (ba99be1c-7b96-4086-a59d-23d3267f528f): created successfully Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9f78b9-4382-455c-a452-86cb9d9f0856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Flow 'volume_create_manager' (1f8e3d26-862a-464e-b9c6-73549eadfd1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:23 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0ef13426-dcc5-4633-829f-a0b03c97105b tempest-TestInstancesWithCinderVolumes-1617454047 None] Created volume successfully. Jul 05 02:48:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b673e9bd-6f43-4948-8ba3-4921ebc57672 tempest-VolumesActionsTest-623115873 None] Acquiring lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379" by "attach_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:48:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b673e9bd-6f43-4948-8ba3-4921ebc57672 tempest-VolumesActionsTest-623115873 None] Lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379" acquired by "attach_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:48:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b673e9bd-6f43-4948-8ba3-4921ebc57672 tempest-VolumesActionsTest-623115873 None] Attaching volume 3d888a3e-bd8d-4534-b102-8c7526aaa379 to instance 0e0084e9-63cc-4960-bbe0-b66cdf5c769f at mountpoint /dev/vdb on host None. Jul 05 02:48:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b673e9bd-6f43-4948-8ba3-4921ebc57672 tempest-VolumesActionsTest-623115873 None] Attach volume completed successfully. Jul 05 02:48:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b673e9bd-6f43-4948-8ba3-4921ebc57672 tempest-VolumesActionsTest-623115873 None] Lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379" released by "attach_volume" :: held 0.151s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:48:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-582553a4-4434-41de-ab20-282956a21695 tempest-VolumesActionsTest-623115873 None] Acquiring lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379-detach_volume" by "detach_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:48:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-582553a4-4434-41de-ab20-282956a21695 tempest-VolumesActionsTest-623115873 None] Lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:48:28 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-582553a4-4434-41de-ab20-282956a21695 tempest-VolumesActionsTest-623115873 None] Detaching volume 3d888a3e-bd8d-4534-b102-8c7526aaa379 from instance 0e0084e9-63cc-4960-bbe0-b66cdf5c769f. Jul 05 02:48:28 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-582553a4-4434-41de-ab20-282956a21695 tempest-VolumesActionsTest-623115873 None] Detach volume completed successfully. Jul 05 02:48:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-582553a4-4434-41de-ab20-282956a21695 tempest-VolumesActionsTest-623115873 None] Lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:48:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-0c5ef5b1-86ab-46cf-94c3-6caf769b2aae req-1ba1cbc3-fb9f-4bbe-90ec-db92e60f4410 tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-0c5ef5b1-86ab-46cf-94c3-6caf769b2aae req-1ba1cbc3-fb9f-4bbe-90ec-db92e60f4410 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9a1c91-4e9f-49c7-9d8b-c10d6959aac9]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:48:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-0c5ef5b1-86ab-46cf-94c3-6caf769b2aae req-1ba1cbc3-fb9f-4bbe-90ec-db92e60f4410 tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:31 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f Jul 05 02:48:31 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:32 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-0c5ef5b1-86ab-46cf-94c3-6caf769b2aae req-1ba1cbc3-fb9f-4bbe-90ec-db92e60f4410 tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f" returned: 0 in 1.023s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-0c5ef5b1-86ab-46cf-94c3-6caf769b2aae req-1ba1cbc3-fb9f-4bbe-90ec-db92e60f4410 tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:32 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f Jul 05 02:48:32 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:33 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-0c5ef5b1-86ab-46cf-94c3-6caf769b2aae req-1ba1cbc3-fb9f-4bbe-90ec-db92e60f4410 tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f" returned: 1 in 0.915s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-0c5ef5b1-86ab-46cf-94c3-6caf769b2aae req-1ba1cbc3-fb9f-4bbe-90ec-db92e60f4410 tempest-TestInstancesWithCinderVolumes-1617454047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:48:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-0c5ef5b1-86ab-46cf-94c3-6caf769b2aae req-1ba1cbc3-fb9f-4bbe-90ec-db92e60f4410 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.986s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-0c5ef5b1-86ab-46cf-94c3-6caf769b2aae req-1ba1cbc3-fb9f-4bbe-90ec-db92e60f4410 tempest-TestInstancesWithCinderVolumes-1617454047 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-ba99be1c-7b96-4086-a59d-23d3267f528f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70f164e4-0a79-488d-afd5-1cb4645909d2', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:48:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-0c5ef5b1-86ab-46cf-94c3-6caf769b2aae req-1ba1cbc3-fb9f-4bbe-90ec-db92e60f4410 tempest-TestInstancesWithCinderVolumes-1617454047 None] attachment_update completed successfully. Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (53555281-663f-4e3a-a9ae-e88664d0a0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2745c7c0-86d0-4094-8fa5-295aa4467f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2745c7c0-86d0-4094-8fa5-295aa4467f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2089464665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47df6bcd-b43c-48b4-8e81-345bce607f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:39Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f897c68d-8e30-4fc3-8cfc-2c91c40e288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f897c68d-8e30-4fc3-8cfc-2c91c40e288f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5caa8fd6-de3a-43b7-a955-1d3ffb0b15be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5caa8fd6-de3a-43b7-a955-1d3ffb0b15be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47df6bcd-b43c-48b4-8e81-345bce607f6f', 'volume_name': 'volume-47df6bcd-b43c-48b4-8e81-345bce607f6f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3671e3ed-e83a-4dd0-987e-795eefbb287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3671e3ed-e83a-4dd0-987e-795eefbb287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe00571-ac75-4a71-bf09-755cb1204c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:38 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Volume 47df6bcd-b43c-48b4-8e81-345bce607f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47df6bcd-b43c-48b4-8e81-345bce607f6f', 'volume_size': 1} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2089464665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47df6bcd-b43c-48b4-8e81-345bce607f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:39Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Creating volume 47df6bcd-b43c-48b4-8e81-345bce607f6f {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:48:38 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:48:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:38 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f 1073741824 Jul 05 02:48:38 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:39 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f 1073741824" returned: 0 in 1.108s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:39 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f Jul 05 02:48:39 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:40 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f" returned: 0 in 0.806s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:48:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe00571-ac75-4a71-bf09-755cb1204c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47df6bcd-b43c-48b4-8e81-345bce607f6f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511a0ce9-46ce-4359-8392-a64d6d763e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:40 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Volume volume-47df6bcd-b43c-48b4-8e81-345bce607f6f (47df6bcd-b43c-48b4-8e81-345bce607f6f): created successfully Jul 05 02:48:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511a0ce9-46ce-4359-8392-a64d6d763e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (53555281-663f-4e3a-a9ae-e88664d0a0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9a851747-59c5-403c-a1a4-65b7ebaf19c7 tempest-VolumesActionsTest-1186915515 None] Created volume successfully. Jul 05 02:48:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-116e8892-1b92-4cd5-ac36-e3d4d379c22e tempest-VolumesActionsTest-1186915515 None] Acquiring lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f" by "attach_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:48:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-116e8892-1b92-4cd5-ac36-e3d4d379c22e tempest-VolumesActionsTest-1186915515 None] Lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f" acquired by "attach_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:48:41 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-116e8892-1b92-4cd5-ac36-e3d4d379c22e tempest-VolumesActionsTest-1186915515 None] Attaching volume 47df6bcd-b43c-48b4-8e81-345bce607f6f to instance 4b4fef66-d083-43c3-8080-fe06682a4f86 at mountpoint /dev/vdb on host None. Jul 05 02:48:41 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-116e8892-1b92-4cd5-ac36-e3d4d379c22e tempest-VolumesActionsTest-1186915515 None] Attach volume completed successfully. Jul 05 02:48:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-116e8892-1b92-4cd5-ac36-e3d4d379c22e tempest-VolumesActionsTest-1186915515 None] Lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f" released by "attach_volume" :: held 0.157s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:48:42 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f5f831f3-ab26-46d4-b604-06ef5d8971e0 tempest-VolumesActionsTest-728994152 None] Terminate volume connection completed successfully. Jul 05 02:48:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f5f831f3-ab26-46d4-b604-06ef5d8971e0 tempest-VolumesActionsTest-728994152 None] Acquiring lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f-detach_volume" by "detach_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:48:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f5f831f3-ab26-46d4-b604-06ef5d8971e0 tempest-VolumesActionsTest-728994152 None] Lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:48:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f5f831f3-ab26-46d4-b604-06ef5d8971e0 tempest-VolumesActionsTest-728994152 None] Detaching volume 47df6bcd-b43c-48b4-8e81-345bce607f6f from instance 4b4fef66-d083-43c3-8080-fe06682a4f86. Jul 05 02:48:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f5f831f3-ab26-46d4-b604-06ef5d8971e0 tempest-VolumesActionsTest-728994152 None] Detach volume completed successfully. Jul 05 02:48:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f5f831f3-ab26-46d4-b604-06ef5d8971e0 tempest-VolumesActionsTest-728994152 None] Lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f-detach_volume" released by "detach_volume" :: held 0.135s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:48:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-73e8094f-1dbb-4d20-8316-186672c68514 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f-detach_volume" by "detach_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:48:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-73e8094f-1dbb-4d20-8316-186672c68514 tempest-VolumesActionsTest-1186915515 None] Lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:48:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-73e8094f-1dbb-4d20-8316-186672c68514 tempest-VolumesActionsTest-1186915515 None] Volume detach called, but volume not attached. Jul 05 02:48:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-73e8094f-1dbb-4d20-8316-186672c68514 tempest-VolumesActionsTest-1186915515 None] Lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:48:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:48:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:48:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "cinder-quobyte-47df6bcd-b43c-48b4-8e81-345bce607f6f" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:48:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Lock "cinder-quobyte-47df6bcd-b43c-48b4-8e81-345bce607f6f" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:48:45 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d63749f-087b-4b90-a7dc-c590305bf7c4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:48:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:45 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f Jul 05 02:48:45 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:47 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f" returned: 0 in 2.104s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:47 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f Jul 05 02:48:47 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:48 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-47df6bcd-b43c-48b4-8e81-345bce607f6f" returned: 0 in 0.938s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:48 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Lock "cinder-quobyte-47df6bcd-b43c-48b4-8e81-345bce607f6f" released by "delete_volume" :: held 3.151s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:48:48 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Created reservations ['f94752f5-b45b-405f-86ac-6d665d1f036d', '52cb8127-e5a4-4fbe-b433-7a36a8b2cf10', 'dafbffa6-36f9-4fbd-8d45-6da66e8f30e0', 'a82bcd60-14c0-4382-ae10-8c05c460102c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:48:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:48:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:48:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:48 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:48:48 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:50 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.263s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:50 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:48:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Deleted volume successfully. Jul 05 02:48:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b2b10bf7-32d2-4443-94d6-7479f98aaa73 tempest-VolumesActionsTest-1186915515 None] Lock "cinder-47df6bcd-b43c-48b4-8e81-345bce607f6f-delete_volume" released by "delete_volume" :: held 4.723s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:48:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-368f7899-b2d2-4db4-882d-15c55ea00062 tempest-VolumesActionsTest-623115873 None] Acquiring lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379" by "attach_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:48:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-368f7899-b2d2-4db4-882d-15c55ea00062 tempest-VolumesActionsTest-623115873 None] Lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379" acquired by "attach_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:48:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-368f7899-b2d2-4db4-882d-15c55ea00062 tempest-VolumesActionsTest-623115873 None] Attaching volume 3d888a3e-bd8d-4534-b102-8c7526aaa379 to instance 83d9c33a-82f4-423c-8379-c0b7cd02d481 at mountpoint /dev/vdb on host None. Jul 05 02:48:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-368f7899-b2d2-4db4-882d-15c55ea00062 tempest-VolumesActionsTest-623115873 None] Attach volume completed successfully. Jul 05 02:48:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-368f7899-b2d2-4db4-882d-15c55ea00062 tempest-VolumesActionsTest-623115873 None] Lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379" released by "attach_volume" :: held 0.152s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-37584c7d-6e3a-42ba-ad7f-366d0f323b42 tempest-VolumesActionsTest-623115873 None] Acquiring lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379-detach_volume" by "detach_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-37584c7d-6e3a-42ba-ad7f-366d0f323b42 tempest-VolumesActionsTest-623115873 None] Lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:48:58 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-37584c7d-6e3a-42ba-ad7f-366d0f323b42 tempest-VolumesActionsTest-623115873 None] Detaching volume 3d888a3e-bd8d-4534-b102-8c7526aaa379 from instance 83d9c33a-82f4-423c-8379-c0b7cd02d481. Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (aa96fa21-10fc-41bb-bae2-5f7394f9a184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c367af3-dfa2-41c9-8e06-7ad96c3801e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c367af3-dfa2-41c9-8e06-7ad96c3801e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-562438787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0165c5-d275-458f-a6c7-4f5446997d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:58Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc8983d-1fc2-4d1f-9f70-0cbd57623941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc8983d-1fc2-4d1f-9f70-0cbd57623941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd524338-9cb9-46b5-ba67-a970f0e95347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd524338-9cb9-46b5-ba67-a970f0e95347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0165c5-d275-458f-a6c7-4f5446997d52', 'volume_name': 'volume-7a0165c5-d275-458f-a6c7-4f5446997d52', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4f6233-b84f-4aac-9777-c775e1e28d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4f6233-b84f-4aac-9777-c775e1e28d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b40ce26-8530-4563-a3f8-d20f9b16d48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:58 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Volume 7a0165c5-d275-458f-a6c7-4f5446997d52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0165c5-d275-458f-a6c7-4f5446997d52', 'volume_size': 1} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-562438787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0165c5-d275-458f-a6c7-4f5446997d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:48:58Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Creating volume 7a0165c5-d275-458f-a6c7-4f5446997d52 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:48:58 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:58 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52 1073741824 Jul 05 02:48:58 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:58 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-37584c7d-6e3a-42ba-ad7f-366d0f323b42 tempest-VolumesActionsTest-623115873 None] Detach volume completed successfully. Jul 05 02:48:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-37584c7d-6e3a-42ba-ad7f-366d0f323b42 tempest-VolumesActionsTest-623115873 None] Lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379-detach_volume" released by "detach_volume" :: held 0.194s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:48:59 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52 1073741824" returned: 0 in 0.903s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=52,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:48:59 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52 Jul 05 02:48:59 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:48:59 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52" returned: 0 in 0.632s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=41,cinder:SELECT=46,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b40ce26-8530-4563-a3f8-d20f9b16d48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0165c5-d275-458f-a6c7-4f5446997d52', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f687500-f2ff-4154-831f-2d6c66220d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:48:59 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Volume volume-7a0165c5-d275-458f-a6c7-4f5446997d52 (7a0165c5-d275-458f-a6c7-4f5446997d52): created successfully Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f687500-f2ff-4154-831f-2d6c66220d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:48:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (aa96fa21-10fc-41bb-bae2-5f7394f9a184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:48:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1ac1754d-2891-4b32-b67c-11a341261be2 tempest-VolumesActionsTest-1186915515 None] Created volume successfully. Jul 05 02:49:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Acquiring lock "cinder-7a0165c5-d275-458f-a6c7-4f5446997d52-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Lock "cinder-7a0165c5-d275-458f-a6c7-4f5446997d52-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Acquiring lock "cinder-quobyte-7a0165c5-d275-458f-a6c7-4f5446997d52" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Lock "cinder-quobyte-7a0165c5-d275-458f-a6c7-4f5446997d52" acquired by "delete_volume" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:00 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d96951a-6eb8-4d13-9db8-52b842545c5b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:00 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52 Jul 05 02:49:00 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:01 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52" returned: 0 in 0.805s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:01 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52 Jul 05 02:49:01 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:01 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7a0165c5-d275-458f-a6c7-4f5446997d52" returned: 0 in 0.703s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Lock "cinder-quobyte-7a0165c5-d275-458f-a6c7-4f5446997d52" released by "delete_volume" :: held 1.544s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Created reservations ['0f8872e7-6b88-4ff1-ad34-3b3809ba9a6f', '6f0b0f91-6bc8-4481-9545-78b6e23d3ce7', '6bfe1f9f-7a5f-4884-ab6e-86835a747feb', '349d728f-3fc7-4051-b0bb-1e1735302d0b'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:01 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:49:01 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:02 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.685s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:02 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:49:02 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Deleted volume successfully. Jul 05 02:49:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d3cc6f82-3bed-4fb2-ac3c-720def5603a9 tempest-VolumesActionsTest-728994152 None] Lock "cinder-7a0165c5-d275-458f-a6c7-4f5446997d52-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:02 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (6c84fe5b-4d5a-4f3a-b232-5e0397c9bbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6b422b-2da1-4403-98d0-f4d3813070e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6b422b-2da1-4403-98d0-f4d3813070e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1524096298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff29998a-54af-4632-8490-1b20c037f119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:49:03Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4172fef7-8816-4e41-a66b-53bf0592f3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4172fef7-8816-4e41-a66b-53bf0592f3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fff925-3d4f-45bf-87cd-95a31b60424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fff925-3d4f-45bf-87cd-95a31b60424c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff29998a-54af-4632-8490-1b20c037f119', 'volume_name': 'volume-ff29998a-54af-4632-8490-1b20c037f119', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f96e9e-8adc-4c92-9200-56d87e5e1787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f96e9e-8adc-4c92-9200-56d87e5e1787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14eafaf0-a748-41f7-93ad-19e2dc2dc18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:03 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Volume ff29998a-54af-4632-8490-1b20c037f119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff29998a-54af-4632-8490-1b20c037f119', 'volume_size': 1} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1524096298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff29998a-54af-4632-8490-1b20c037f119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:49:03Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Creating volume ff29998a-54af-4632-8490-1b20c037f119 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:49:03 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:03 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119 1073741824 Jul 05 02:49:03 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:03 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119 1073741824" returned: 0 in 0.807s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:03 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119 Jul 05 02:49:03 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:04 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119" returned: 0 in 0.650s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:49:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14eafaf0-a748-41f7-93ad-19e2dc2dc18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff29998a-54af-4632-8490-1b20c037f119', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd0fdd4-0bb1-416e-b3fe-afcb481bb4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:04 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Volume volume-ff29998a-54af-4632-8490-1b20c037f119 (ff29998a-54af-4632-8490-1b20c037f119): created successfully Jul 05 02:49:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd0fdd4-0bb1-416e-b3fe-afcb481bb4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (6c84fe5b-4d5a-4f3a-b232-5e0397c9bbd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:49:04 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-09d2ff97-60a6-44af-8375-acd14cb94864 tempest-VolumesActionsTest-1186915515 None] Created volume successfully. Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Acquiring lock "cinder-ff29998a-54af-4632-8490-1b20c037f119-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:05 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:49:05 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Lock "cinder-ff29998a-54af-4632-8490-1b20c037f119-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Acquiring lock "cinder-quobyte-ff29998a-54af-4632-8490-1b20c037f119" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Lock "cinder-quobyte-ff29998a-54af-4632-8490-1b20c037f119" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b536e3-211e-46bf-bc97-1334b3826d5b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:05 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119 Jul 05 02:49:05 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:05 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.713s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:49:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:49:06 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119" returned: 0 in 0.827s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:06 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119 Jul 05 02:49:06 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:06 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff29998a-54af-4632-8490-1b20c037f119" returned: 0 in 0.674s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Lock "cinder-quobyte-ff29998a-54af-4632-8490-1b20c037f119" released by "delete_volume" :: held 1.542s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:06 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Created reservations ['5db4607f-c543-4da5-8c5b-e652bdd8c337', '6bd60b86-585f-4ed5-81d3-f3157e01e580', '19e167a4-0fa9-4303-bc3b-6ea2253434c5', 'a9460844-45d1-4f47-97c3-b6c7d0d4cb60'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:49:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:07 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:49:07 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:07 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.699s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:07 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:49:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Deleted volume successfully. Jul 05 02:49:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3421173d-a36c-4b2d-a04b-70305757459c tempest-VolumesActionsTest-728994152 None] Lock "cinder-ff29998a-54af-4632-8490-1b20c037f119-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (a574e90c-1633-405e-b53c-6529f20a7767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25df0db3-8140-412c-9a3b-6bcb179fabfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25df0db3-8140-412c-9a3b-6bcb179fabfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-193176359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09ec0be-e032-4d8e-851c-21e9f7a62223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:49:08Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909c0fb6-7613-45ce-9ad4-ebf0ea375d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909c0fb6-7613-45ce-9ad4-ebf0ea375d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcabe37d-6661-4167-8119-a0fd296bd3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcabe37d-6661-4167-8119-a0fd296bd3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09ec0be-e032-4d8e-851c-21e9f7a62223', 'volume_name': 'volume-e09ec0be-e032-4d8e-851c-21e9f7a62223', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f72d7b-da52-4f16-9526-5c870e9f9d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f72d7b-da52-4f16-9526-5c870e9f9d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6962d7-0126-42f6-8902-cd66d3222e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:08 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Volume e09ec0be-e032-4d8e-851c-21e9f7a62223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09ec0be-e032-4d8e-851c-21e9f7a62223', 'volume_size': 1} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-193176359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09ec0be-e032-4d8e-851c-21e9f7a62223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:49:08Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Creating volume e09ec0be-e032-4d8e-851c-21e9f7a62223 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:49:08 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:08 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223 1073741824 Jul 05 02:49:08 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:09 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223 1073741824" returned: 0 in 0.845s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:09 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223 Jul 05 02:49:09 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:09 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223" returned: 0 in 0.657s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.899s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c6962d7-0126-42f6-8902-cd66d3222e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09ec0be-e032-4d8e-851c-21e9f7a62223', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c076af-93fa-44f7-83d4-e510abc60dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eeb2396-555b-4261-bcae-8fa3558509b5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:09 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Volume volume-e09ec0be-e032-4d8e-851c-21e9f7a62223 (e09ec0be-e032-4d8e-851c-21e9f7a62223): created successfully Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c076af-93fa-44f7-83d4-e510abc60dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (a574e90c-1633-405e-b53c-6529f20a7767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:49:09 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-37fc9799-460b-432f-9d52-5827132072bf tempest-VolumesActionsTest-1186915515 None] Created volume successfully. Jul 05 02:49:09 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 Jul 05 02:49:09 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Acquiring lock "cinder-e09ec0be-e032-4d8e-851c-21e9f7a62223-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Lock "cinder-e09ec0be-e032-4d8e-851c-21e9f7a62223-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Acquiring lock "cinder-quobyte-e09ec0be-e032-4d8e-851c-21e9f7a62223" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Lock "cinder-quobyte-e09ec0be-e032-4d8e-851c-21e9f7a62223" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:10 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af938fe-e985-4833-8d24-d6c4312862c4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:10 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223 Jul 05 02:49:10 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:10 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379" returned: 0 in 0.818s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-f5f7a903-0d92-4be6-98fb-499f7875b976 req-c282a303-95ef-495f-9066-44e095ed375e tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:10 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3f2079-4760-4c77-a1ab-c7d3dadf2a2b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:10 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 Jul 05 02:49:10 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:11 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223" returned: 0 in 0.800s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:11 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223 Jul 05 02:49:11 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:11 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379" returned: 0 in 0.794s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.ff589b7d-55a6-42a6-a795-8bbcb27568ccrca6eu4a.img {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:11 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.ff589b7d-55a6-42a6-a795-8bbcb27568ccrca6eu4a.img Jul 05 02:49:11 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:11 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e09ec0be-e032-4d8e-851c-21e9f7a62223" returned: 0 in 0.633s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Lock "cinder-quobyte-e09ec0be-e032-4d8e-851c-21e9f7a62223" released by "delete_volume" :: held 1.480s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:11 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Created reservations ['b86649b7-0d97-4466-b37a-e1187c75c3c4', '89e65d71-1151-4367-964f-796a31a757a1', '8a39ffc8-6c50-41b2-b877-bbe9a4811f90', 'ed117382-3e92-4f4a-acf4-3a354851aa35'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:49:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:12 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:49:12 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:13 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.449s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:13 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:49:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Deleted volume successfully. Jul 05 02:49:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-808f51c6-55a0-4618-9178-2cf98cca41c4 tempest-VolumesActionsTest-728994152 None] Lock "cinder-e09ec0be-e032-4d8e-851c-21e9f7a62223-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:13 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (c11a771e-8fe7-4b19-ab04-f11081e7f43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f5c194-59a1-4394-99e0-2576bbdec17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f5c194-59a1-4394-99e0-2576bbdec17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847305566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afcca65-dfe7-4349-bbf8-20c243c2c217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:49:14Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84a4f71-1120-4015-b4f3-3712d7ea3cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f84a4f71-1120-4015-b4f3-3712d7ea3cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51f787a-e4b0-4073-ae9d-7e66955e4e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51f787a-e4b0-4073-ae9d-7e66955e4e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7afcca65-dfe7-4349-bbf8-20c243c2c217', 'volume_name': 'volume-7afcca65-dfe7-4349-bbf8-20c243c2c217', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deca7154-0a93-4cc4-9874-e4af38371513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deca7154-0a93-4cc4-9874-e4af38371513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef851cf-9fce-49b6-b7b1-bf3018e80dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:14 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Volume 7afcca65-dfe7-4349-bbf8-20c243c2c217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7afcca65-dfe7-4349-bbf8-20c243c2c217', 'volume_size': 1} Jul 05 02:49:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:16 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.ff589b7d-55a6-42a6-a795-8bbcb27568ccrca6eu4a.img" returned: 0 in 4.748s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:16 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[40515902-334f-4241-905f-cb612f2e58a0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:16 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 Jul 05 02:49:16 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:17 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379" returned: 0 in 0.901s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:17 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.ff589b7d-55a6-42a6-a795-8bbcb27568ccrca6eu4a.img {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:49:17 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Converted 1024.00 MB image at 215.62 MB/s Jul 05 02:49:17 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] ff589b7d-55a6-42a6-a795-8bbcb27568cc was raw, no need to convert to raw {{(pid=86671) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 05 02:49:23 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=26,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:49:27 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=37,cinder:DELETE=5,cinder:SELECT=23,cinder:INSERT=6 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:49:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.069s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Uploaded volume to glance image-id: ff589b7d-55a6-42a6-a795-8bbcb27568cc. {{(pid=86671) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1783}} Jul 05 02:49:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-f5f7a903-0d92-4be6-98fb-499f7875b976 req-c282a303-95ef-495f-9066-44e095ed375e tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.221s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:35 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b6650c-3a06-4c80-aa3b-71de9215971c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-f5f7a903-0d92-4be6-98fb-499f7875b976 req-c282a303-95ef-495f-9066-44e095ed375e tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d79ccd69-fce1-4c97-8341-bf76ac91c3cd tempest-VolumesActionsTest-623115873 None] Copy volume to image completed successfully. Jul 05 02:49:35 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de Jul 05 02:49:35 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:36 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-f5f7a903-0d92-4be6-98fb-499f7875b976 req-c282a303-95ef-495f-9066-44e095ed375e tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de" returned: 0 in 0.755s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-f5f7a903-0d92-4be6-98fb-499f7875b976 req-c282a303-95ef-495f-9066-44e095ed375e tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.426s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-847305566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afcca65-dfe7-4349-bbf8-20c243c2c217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:49:14Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Creating volume 7afcca65-dfe7-4349-bbf8-20c243c2c217 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:49:36 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:36 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217 1073741824 Jul 05 02:49:36 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-f5f7a903-0d92-4be6-98fb-499f7875b976 req-c282a303-95ef-495f-9066-44e095ed375e tempest-TestInstancesWithCinderVolumes-1617454047 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-1276a8d8-08e4-49bf-8499-7bddc43b31de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f655890-1cec-410e-aabb-ef80426db65c', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:49:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-f5f7a903-0d92-4be6-98fb-499f7875b976 req-c282a303-95ef-495f-9066-44e095ed375e tempest-TestInstancesWithCinderVolumes-1617454047 None] attachment_update completed successfully. Jul 05 02:49:37 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217 1073741824" returned: 0 in 0.874s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:37 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217 Jul 05 02:49:37 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:38 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217" returned: 0 in 0.662s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.503s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef851cf-9fce-49b6-b7b1-bf3018e80dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7afcca65-dfe7-4349-bbf8-20c243c2c217', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bb9e42-ee8f-407e-ace8-67835b2973af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2298913b-5c4a-429a-be4c-55bbfcacc69c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:38 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Volume volume-7afcca65-dfe7-4349-bbf8-20c243c2c217 (7afcca65-dfe7-4349-bbf8-20c243c2c217): created successfully Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bb9e42-ee8f-407e-ace8-67835b2973af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (c11a771e-8fe7-4b19-ab04-f11081e7f43a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:49:38 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-97528c58-9f8f-4756-b102-1cbdf49422e3 tempest-VolumesActionsTest-1186915515 None] Created volume successfully. Jul 05 02:49:38 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 Jul 05 02:49:38 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Acquiring lock "cinder-7afcca65-dfe7-4349-bbf8-20c243c2c217-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Lock "cinder-7afcca65-dfe7-4349-bbf8-20c243c2c217-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Acquiring lock "cinder-quobyte-7afcca65-dfe7-4349-bbf8-20c243c2c217" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Lock "cinder-quobyte-7afcca65-dfe7-4349-bbf8-20c243c2c217" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edf010c-52b2-4df3-a174-3543ccf08568]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:38 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379" returned: 0 in 0.794s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08e8f6-7bea-4ae8-be05-557771c2a631]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:39 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217 Jul 05 02:49:39 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:39 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 Jul 05 02:49:39 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:39 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217" returned: 0 in 0.809s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:39 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379" returned: 0 in 0.783s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:39 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217 Jul 05 02:49:39 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:39 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img Jul 05 02:49:39 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:40 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7afcca65-dfe7-4349-bbf8-20c243c2c217" returned: 0 in 0.719s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Lock "cinder-quobyte-7afcca65-dfe7-4349-bbf8-20c243c2c217" released by "delete_volume" :: held 1.605s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:40 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Created reservations ['4284e971-e9f2-4e80-b43c-b846185ce3b4', 'd12a1b4d-808a-4cfe-a8f3-e21237665484', '88ab2778-b773-40eb-aae6-61b37a7ad481', '1d2c06ae-d952-4a48-a918-72f96fd03555'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:49:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:41 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:49:41 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (d3bf0ed2-c2a0-4b40-8c1a-41eeb6407453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5d696d-4f94-40cf-a1d7-53edb972054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5d696d-4f94-40cf-a1d7-53edb972054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1859237065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66c8279-7ce0-4b34-b541-1b85735a1109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:49:42Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a66f27-05f3-424c-9225-f91eb2d267d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a66f27-05f3-424c-9225-f91eb2d267d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78289911-5217-426c-91f6-477821bd7430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78289911-5217-426c-91f6-477821bd7430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a66c8279-7ce0-4b34-b541-1b85735a1109', 'volume_name': 'volume-a66c8279-7ce0-4b34-b541-1b85735a1109', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b26ef8-835f-40ec-b663-c14c638737ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b26ef8-835f-40ec-b663-c14c638737ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57085fcd-4e33-415e-b8bf-28efe5454994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:42 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Volume a66c8279-7ce0-4b34-b541-1b85735a1109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a66c8279-7ce0-4b34-b541-1b85735a1109', 'volume_size': 1} Jul 05 02:49:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:43 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 2.186s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:43 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:49:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Deleted volume successfully. Jul 05 02:49:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3b74be72-1b88-43a2-bdd4-1b85cc5df5b6 tempest-VolumesActionsTest-728994152 None] Lock "cinder-7afcca65-dfe7-4349-bbf8-20c243c2c217-delete_volume" released by "delete_volume" :: held 4.423s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:44 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img" returned: 0 in 5.205s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:44 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[292fa63a-06d7-4a57-be81-2896afed2238]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:45 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 Jul 05 02:49:45 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c9518277-54d7-4d1d-9035-430d3ddb43fa req-90b4841a-ad9c-425d-80d5-1dbdcbef0c7b tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:45 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379" returned: 0 in 0.868s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:45 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:49:45 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Converted 1024.00 MB image at 196.70 MB/s Jul 05 02:49:45 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] b3a88c94-9c07-4025-a95c-adefcf1a61d5 was raw, converting to qcow2 {{(pid=86671) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 05 02:49:45 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[936f69bc-8646-468a-ad48-b1f6b6039acf]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:45 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img Jul 05 02:49:46 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:46 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img" returned: 0 in 0.721s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:46 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img Jul 05 02:49:46 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:47 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img" returned: 1 in 0.726s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:49:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img /opt/stack/data/cinder/conversion/vol_upload_7fhpsyox {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:47 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img /opt/stack/data/cinder/conversion/vol_upload_7fhpsyox Jul 05 02:49:47 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:47 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img /opt/stack/data/cinder/conversion/vol_upload_7fhpsyox" returned: 0 in 0.638s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:47 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Image conversion details: src /opt/stack/data/cinder/conversion/3d888a3e-bd8d-4534-b102-8c7526aaa379.temp_image.b3a88c94-9c07-4025-a95c-adefcf1a61d5msa89kkz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_7fhpsyox {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:49:47 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 05 02:49:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9449519-ae7c-4a28-9d05-4cf1e953b5ef]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7fhpsyox {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:48 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7fhpsyox Jul 05 02:49:48 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:48 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7fhpsyox" returned: 0 in 0.731s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.892s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Uploaded volume to glance image-id: b3a88c94-9c07-4025-a95c-adefcf1a61d5. {{(pid=86671) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1783}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.087s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1859237065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66c8279-7ce0-4b34-b541-1b85735a1109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ee2cf9e0c4c5abf29229f384d28c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:49:42Z,use_quota=True,user_id='7a19a57254754ee9aba719c7ae821b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Creating volume a66c8279-7ce0-4b34-b541-1b85735a1109 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:49:50 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:50 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109 1073741824 Jul 05 02:49:50 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-223e2c2e-2218-469d-b920-aaa3fda406b2 tempest-VolumesActionsTest-623115873 None] Copy volume to image completed successfully. Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Acquiring lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:50 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109 1073741824" returned: 0 in 0.838s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Acquiring lock "cinder-quobyte-3d888a3e-bd8d-4534-b102-8c7526aaa379" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:50 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109 Jul 05 02:49:50 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Lock "cinder-quobyte-3d888a3e-bd8d-4534-b102-8c7526aaa379" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6978abd8-d278-4a0e-a6ad-731fd7c86c2c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:51 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 Jul 05 02:49:51 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:51 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109" returned: 0 in 0.684s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c9518277-54d7-4d1d-9035-430d3ddb43fa req-90b4841a-ad9c-425d-80d5-1dbdcbef0c7b tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.537s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57085fcd-4e33-415e-b8bf-28efe5454994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66c8279-7ce0-4b34-b541-1b85735a1109', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fe74d1-ef45-4cea-89ad-87d305112acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eeed1a-284b-471a-a56b-55663df69832]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c9518277-54d7-4d1d-9035-430d3ddb43fa req-90b4841a-ad9c-425d-80d5-1dbdcbef0c7b tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:51 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Volume volume-a66c8279-7ce0-4b34-b541-1b85735a1109 (a66c8279-7ce0-4b34-b541-1b85735a1109): created successfully Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84fe74d1-ef45-4cea-89ad-87d305112acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Flow 'volume_create_manager' (d3bf0ed2-c2a0-4b40-8c1a-41eeb6407453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:49:51 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8da2fbce-99f6-471e-9893-b67a7662b3c3 tempest-VolumesActionsTest-1186915515 None] Created volume successfully. Jul 05 02:49:51 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 Jul 05 02:49:51 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:51 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379" returned: 0 in 0.805s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:51 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379 Jul 05 02:49:51 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:52 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c9518277-54d7-4d1d-9035-430d3ddb43fa req-90b4841a-ad9c-425d-80d5-1dbdcbef0c7b tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21" returned: 0 in 0.839s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c9518277-54d7-4d1d-9035-430d3ddb43fa req-90b4841a-ad9c-425d-80d5-1dbdcbef0c7b tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.873s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:52 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3d888a3e-bd8d-4534-b102-8c7526aaa379" returned: 0 in 0.707s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Lock "cinder-quobyte-3d888a3e-bd8d-4534-b102-8c7526aaa379" released by "delete_volume" :: held 1.561s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-c9518277-54d7-4d1d-9035-430d3ddb43fa req-90b4841a-ad9c-425d-80d5-1dbdcbef0c7b tempest-TestInstancesWithCinderVolumes-1617454047 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-d500cedc-da37-4273-9fe3-f267617f7f21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78cc82ad-84b6-4ceb-9add-772e48e11e62', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Created reservations ['4dcf91b9-f2e7-4337-a193-8f277dde2e81', '3a511e6d-b2b9-4a17-8570-87827db01e6c', '064fafcc-b7f1-4a16-b9bf-1d52c9afdcd6', 'c9a6aa91-48e5-4156-a3c4-85386ccd31b8'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:49:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-c9518277-54d7-4d1d-9035-430d3ddb43fa req-90b4841a-ad9c-425d-80d5-1dbdcbef0c7b tempest-TestInstancesWithCinderVolumes-1617454047 None] attachment_update completed successfully. Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:52 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:49:52 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "cinder-a66c8279-7ce0-4b34-b541-1b85735a1109-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Lock "cinder-a66c8279-7ce0-4b34-b541-1b85735a1109-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "cinder-quobyte-a66c8279-7ce0-4b34-b541-1b85735a1109" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Lock "cinder-quobyte-a66c8279-7ce0-4b34-b541-1b85735a1109" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a15504-1817-4bbb-b63f-b40f5137e39f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:49:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:52 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109 Jul 05 02:49:52 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:53 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.709s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:53 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:49:53 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Deleted volume successfully. Jul 05 02:49:53 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a866a46-6f07-453d-bbfc-9d5a1b635e61 tempest-VolumesActionsTest-623115873 None] Lock "cinder-3d888a3e-bd8d-4534-b102-8c7526aaa379-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:53 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109" returned: 0 in 0.868s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:53 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109 Jul 05 02:49:53 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:54 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a66c8279-7ce0-4b34-b541-1b85735a1109" returned: 0 in 0.741s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Lock "cinder-quobyte-a66c8279-7ce0-4b34-b541-1b85735a1109" released by "delete_volume" :: held 1.660s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:49:54 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Created reservations ['23f99f02-49dc-440c-9ba1-b3f615b5777e', 'de0902e4-04e5-4b87-8336-11a5d172cca1', 'b1403ed9-db8e-4d61-a4cf-578a0f139507', '2c7fbef2-fc69-4a88-abf5-db59ab1f2bb5'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:49:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:49:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:49:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:49:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:49:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:49:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:49:54 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:49:54 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:49:55 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jul 05 02:49:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.790s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:49:55 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:49:55 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Deleted volume successfully. Jul 05 02:49:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a0310dd7-8331-4655-820f-c82197b66362 tempest-VolumesActionsTest-1186915515 None] Lock "cinder-a66c8279-7ce0-4b34-b541-1b85735a1109-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Flow 'volume_create_manager' (1ce2578e-7796-4c62-b858-646446ddb50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f54f22e-cd50-4ac7-b94a-5be81ab939ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f54f22e-cd50-4ac7-b94a-5be81ab939ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1645088968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec44a3cc-9954-4559-92d0-d52e1661391a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af1f6ce88ed471e8a9425bd417eaab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:50:00Z,use_quota=True,user_id='eb832431f3644beab29997a643a7bea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98728f4a-fe0f-4502-8bf7-a3722ae48f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98728f4a-fe0f-4502-8bf7-a3722ae48f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fee3dca-9cac-4bbf-86f0-72ff23d838ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.image.glance [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Creating Keystone auth plugin from conf {{(pid=86671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fee3dca-9cac-4bbf-86f0-72ff23d838ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec44a3cc-9954-4559-92d0-d52e1661391a', 'volume_name': 'volume-ec44a3cc-9954-4559-92d0-d52e1661391a', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd40afcd-17a4-44da-86a5-9a6985e2331a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd40afcd-17a4-44da-86a5-9a6985e2331a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363b5a84-460f-4c97-be5d-3cce71611744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:00 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Volume ec44a3cc-9954-4559-92d0-d52e1661391a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec44a3cc-9954-4559-92d0-d52e1661391a', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 02:50:00 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Trying to clone ec44a3cc-9954-4559-92d0-d52e1661391a from image c1baa924-f45f-4a01-ae62-ac21392667fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]). {{(pid=86671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 05 02:50:01 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 02:50:01 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Image download 20.69 MB at 20.69 MB/s Jul 05 02:50:01 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa260a5d-87c8-4377-8e6e-42ab728a1f37]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:01 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD Jul 05 02:50:01 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:02 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:02 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Temporary image c1baa924-f45f-4a01-ae62-ac21392667fc is fetched for user eb832431f3644beab29997a643a7bea5. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 02:50:02 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da626ce-6945-4d22-b2df-7b1538798c2a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:02 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD Jul 05 02:50:02 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:03 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1645088968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec44a3cc-9954-4559-92d0-d52e1661391a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af1f6ce88ed471e8a9425bd417eaab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:50:00Z,use_quota=True,user_id='eb832431f3644beab29997a643a7bea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Creating volume ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:50:03 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-5e1ffe74-7ff2-45df-af76-e9e03cb40ae7 req-c380d69c-2a1d-4c7c-bfc0-104c8930d98d tempest-TestInstancesWithCinderVolumes-1617454047 None] Terminate volume connection completed successfully. Jul 05 02:50:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-5e1ffe74-7ff2-45df-af76-e9e03cb40ae7 req-c380d69c-2a1d-4c7c-bfc0-104c8930d98d tempest-TestInstancesWithCinderVolumes-1617454047 None] Deleting attachment 6f655890-1cec-410e-aabb-ef80426db65c. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:50:03 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a 1073741824 Jul 05 02:50:03 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:04 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a 1073741824" returned: 0 in 0.960s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:04 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a Jul 05 02:50:04 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:04 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a" returned: 0 in 0.716s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:50:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:04 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Attempting download of c1baa924-f45f-4a01-ae62-ac21392667fc ((None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}])) to volume ec44a3cc-9954-4559-92d0-d52e1661391a. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 02:50:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e07a8eb-5d87-4455-afc8-e639248e53ba]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_n2bjhkz9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:04 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_n2bjhkz9 Jul 05 02:50:04 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "cinder-1276a8d8-08e4-49bf-8499-7bddc43b31de-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-1276a8d8-08e4-49bf-8499-7bddc43b31de-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "cinder-quobyte-1276a8d8-08e4-49bf-8499-7bddc43b31de" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-quobyte-1276a8d8-08e4-49bf-8499-7bddc43b31de" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7523bddd-54e1-403e-af14-d37d57618ea0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:05 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:50:05 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:05 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de Jul 05 02:50:05 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:05 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_n2bjhkz9" returned: 0 in 0.892s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_n2bjhkz9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:05 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_n2bjhkz9 Jul 05 02:50:05 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:06 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.947s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:50:06 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de" returned: 0 in 1.131s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:06 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de Jul 05 02:50:06 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:06 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_n2bjhkz9" returned: 1 in 0.903s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_n2bjhkz9' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a36b4b5-9c3b-4f86-b706-b6de1b2e9aeb]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:06 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD Jul 05 02:50:06 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:07 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1276a8d8-08e4-49bf-8499-7bddc43b31de" returned: 0 in 0.762s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-quobyte-1276a8d8-08e4-49bf-8499-7bddc43b31de" released by "delete_volume" :: held 1.946s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:07 devstack cinder-volume[86671]: WARNING cinder.quota [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-8911911-1072379732 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-8911911-1072379732, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:50:07 devstack cinder-volume[86671]: WARNING cinder.quota [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-8911911-1072379732 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-8911911-1072379732, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Created reservations ['5ecacf52-b50b-4a4c-ad7e-92ed732ce48a', 'ace60b64-228e-4510-b11c-9a728bac32be', '9126369e-0632-42b1-9978-825c9a35f806', '56f92d48-51d0-4152-aedd-8f5706a22d56'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:07 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:50:07 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:07 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] c1baa924-f45f-4a01-ae62-ac21392667fc was qcow2, converting to raw {{(pid=86671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 02:50:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:07 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a Jul 05 02:50:07 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:08 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.762s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:50:08 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Deleted volume successfully. Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e69b67ac-dc59-45c1-974d-6483d1e5d260 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-1276a8d8-08e4-49bf-8499-7bddc43b31de-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Flow 'volume_create_manager' (65b90a15-a8d8-4ba2-bf97-f1f1dbc90386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7a651f-5ad4-47bf-9367-c533b7720781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7a651f-5ad4-47bf-9367-c533b7720781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1570079533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7605ae74-12eb-4682-8d6c-85b5f50db1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d2bf826da74b2eba74782c996d2d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:50:08Z,use_quota=True,user_id='ab0d95cbc32e47d5a82f072d326e3760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4161f82c-f56f-442f-be2f-cb17cdf2a61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4161f82c-f56f-442f-be2f-cb17cdf2a61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0236e3d7-b4ee-4e1f-8b7b-93a98a67328f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0236e3d7-b4ee-4e1f-8b7b-93a98a67328f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7605ae74-12eb-4682-8d6c-85b5f50db1a5', 'volume_name': 'volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f61baf-f6ae-4a3e-8932-ac92dff51aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f61baf-f6ae-4a3e-8932-ac92dff51aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5489cd-2891-42c2-be7c-fae2f8040062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:08 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Volume 7605ae74-12eb-4682-8d6c-85b5f50db1a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5', 'volume_size': 1} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1570079533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7605ae74-12eb-4682-8d6c-85b5f50db1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d2bf826da74b2eba74782c996d2d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:50:08Z,use_quota=True,user_id='ab0d95cbc32e47d5a82f072d326e3760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Creating volume 7605ae74-12eb-4682-8d6c-85b5f50db1a5 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:50:08 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:50:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:08 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5 1073741824 Jul 05 02:50:08 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:09 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5 1073741824" returned: 0 in 0.943s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:09 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5 Jul 05 02:50:09 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:09 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a" returned: 0 in 2.089s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:09 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_da8rhdixdevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:50:09 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Converted 112.00 MB image at 53.58 MB/s Jul 05 02:50:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:09 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a 1G Jul 05 02:50:09 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:10 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5" returned: 0 in 0.702s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5489cd-2891-42c2-be7c-fae2f8040062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c9fb8e-e669-4dab-82c8-2d8eb6f98409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:10 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Volume volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5 (7605ae74-12eb-4682-8d6c-85b5f50db1a5): created successfully Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c9fb8e-e669-4dab-82c8-2d8eb6f98409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Flow 'volume_create_manager' (65b90a15-a8d8-4ba2-bf97-f1f1dbc90386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:50:10 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1bfe28e6-8f19-4f9a-997e-a09c79c3a250 tempest-AbsoluteLimitsTests-747438342 None] Created volume successfully. Jul 05 02:50:10 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-3dcf86d4-2aed-42eb-9bcc-f755dca1f98e req-c7d725b9-8d0c-4189-adc5-24a8b5171d35 tempest-TestInstancesWithCinderVolumes-1617454047 None] Terminate volume connection completed successfully. Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-3dcf86d4-2aed-42eb-9bcc-f755dca1f98e req-c7d725b9-8d0c-4189-adc5-24a8b5171d35 tempest-TestInstancesWithCinderVolumes-1617454047 None] Deleting attachment 78cc82ad-84b6-4ceb-9add-772e48e11e62. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:50:10 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a 1G" returned: 0 in 0.726s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e7a104-2a89-4b89-b065-28a8f1278b68]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Acquiring lock "cinder-7605ae74-12eb-4682-8d6c-85b5f50db1a5-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:10 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a Jul 05 02:50:10 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Lock "cinder-7605ae74-12eb-4682-8d6c-85b5f50db1a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Acquiring lock "cinder-quobyte-7605ae74-12eb-4682-8d6c-85b5f50db1a5" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Lock "cinder-quobyte-7605ae74-12eb-4682-8d6c-85b5f50db1a5" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3078052e-38b1-4d51-b0ce-83c2702cc283]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:10 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5 Jul 05 02:50:10 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:11 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a" returned: 0 in 0.805s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:11 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a Jul 05 02:50:11 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:11 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5" returned: 0 in 0.794s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:11 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5 Jul 05 02:50:11 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:11 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a" returned: 1 in 0.764s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Downloaded image c1baa924-f45f-4a01-ae62-ac21392667fc ((None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}])) to volume ec44a3cc-9954-4559-92d0-d52e1661391a successfully. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Temporary image c1baa924-f45f-4a01-ae62-ac21392667fc for user eb832431f3644beab29997a643a7bea5 is deleted. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Marking volume ec44a3cc-9954-4559-92d0-d52e1661391a as bootable. {{(pid=86671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Copying metadata from image c1baa924-f45f-4a01-ae62-ac21392667fc to ec44a3cc-9954-4559-92d0-d52e1661391a. {{(pid=86671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 02:50:11 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Creating volume glance metadata for volume ec44a3cc-9954-4559-92d0-d52e1661391a backed by image c1baa924-f45f-4a01-ae62-ac21392667fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 02:50:12 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7605ae74-12eb-4682-8d6c-85b5f50db1a5" returned: 0 in 0.662s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363b5a84-460f-4c97-be5d-3cce71611744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec44a3cc-9954-4559-92d0-d52e1661391a', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a2e613-1757-4b03-9ff6-5ccbd13e74cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Lock "cinder-quobyte-7605ae74-12eb-4682-8d6c-85b5f50db1a5" released by "delete_volume" :: held 1.513s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:12 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Volume volume-ec44a3cc-9954-4559-92d0-d52e1661391a (ec44a3cc-9954-4559-92d0-d52e1661391a): created successfully Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a2e613-1757-4b03-9ff6-5ccbd13e74cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Flow 'volume_create_manager' (1ce2578e-7796-4c62-b858-646446ddb50b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:50:12 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f702ad7d-b77c-4745-ad5a-372601977f37 tempest-VolumesExtendTest-2051439708 None] Created volume successfully. Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Created reservations ['74654c84-baa3-459d-a3e3-64656b3e749e', '9f876fea-211d-424b-9661-7090b59fdee9', 'dcb0f5d7-477c-47cf-9a96-39ffd1fb78ec', '4c625e17-b274-4049-a0c7-a644cb2ead52'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "cinder-d500cedc-da37-4273-9fe3-f267617f7f21-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:12 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:50:12 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-d500cedc-da37-4273-9fe3-f267617f7f21-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "cinder-quobyte-d500cedc-da37-4273-9fe3-f267617f7f21" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-quobyte-d500cedc-da37-4273-9fe3-f267617f7f21" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ed8724-c82a-43e5-b231-463a6e568d71]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc2a2f2-d21b-4164-bdb8-c11b99cd7adf]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:12 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 Jul 05 02:50:12 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:12 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a Jul 05 02:50:12 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:13 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.778s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:13 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:50:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Deleted volume successfully. Jul 05 02:50:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7b5f8fb9-811e-473b-8ab0-19c4a0ba3612 tempest-AbsoluteLimitsTests-747438342 None] Lock "cinder-7605ae74-12eb-4682-8d6c-85b5f50db1a5-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:13 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a" returned: 0 in 0.929s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:13 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21" returned: 0 in 1.088s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:13 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21 Jul 05 02:50:13 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:13 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a Jul 05 02:50:13 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:14 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d500cedc-da37-4273-9fe3-f267617f7f21" returned: 0 in 0.958s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-quobyte-d500cedc-da37-4273-9fe3-f267617f7f21" released by "delete_volume" :: held 2.109s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:14 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a" returned: 1 in 1.079s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a 2G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:14 devstack cinder-volume[86671]: WARNING cinder.quota [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-46147307-92408564 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-46147307-92408564, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:50:14 devstack cinder-volume[86671]: WARNING cinder.quota [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-46147307-92408564 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-46147307-92408564, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Created reservations ['803dea5d-077a-422c-af17-0cfceca9c0fc', 'cd727580-434c-4662-803f-f9e16d6498c0', '038f8624-a1b0-48c7-9330-80fc99122cb5', '75ac6b49-c1ca-4217-a0ee-db2869eff68e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a 2G" returned: 0 in 0.093s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.173s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:14 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a536646a-3239-498e-aefb-5128f37a5b44 tempest-VolumesExtendTest-2051439708 None] Extend volume completed successfully. Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:14 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:50:14 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:15 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.997s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:15 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:50:15 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Deleted volume successfully. Jul 05 02:50:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1a1f95a3-fb8c-429f-80d0-f8e1f2e0f408 tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-d500cedc-da37-4273-9fe3-f267617f7f21-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "cinder-ec44a3cc-9954-4559-92d0-d52e1661391a-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-ec44a3cc-9954-4559-92d0-d52e1661391a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "cinder-quobyte-ec44a3cc-9954-4559-92d0-d52e1661391a" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-quobyte-ec44a3cc-9954-4559-92d0-d52e1661391a" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:16 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57f38bc-47d2-40ca-9664-249eff750ddd]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:16 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a Jul 05 02:50:16 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:16 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a" returned: 0 in 0.852s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:17 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a Jul 05 02:50:17 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:18 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a" returned: 1 in 1.064s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:18 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a Jul 05 02:50:18 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Flow 'volume_create_manager' (b23b97c4-1e1a-4ae3-a5eb-fb838eb8a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba47e74c-96e6-4530-8850-de96c93abbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba47e74c-96e6-4530-8850-de96c93abbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1095923581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3aab50c-d36b-4e85-bcaf-71ea5debb671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a5e14d3c304a20a4edb25278bb8c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:50:18Z,use_quota=True,user_id='c025f9017b9b4c1bbce13382abcad405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66351d6-eeec-45de-ad93-bee1992643a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66351d6-eeec-45de-ad93-bee1992643a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289ba5e8-fdb8-4792-874f-02adb7e59941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289ba5e8-fdb8-4792-874f-02adb7e59941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3aab50c-d36b-4e85-bcaf-71ea5debb671', 'volume_name': 'volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006877e0-4d4d-475c-9acb-01d07d992c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006877e0-4d4d-475c-9acb-01d07d992c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7010d41-ee20-4431-8b40-97bc628bb31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:18 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Volume b3aab50c-d36b-4e85-bcaf-71ea5debb671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671', 'volume_size': 1} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1095923581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3aab50c-d36b-4e85-bcaf-71ea5debb671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a5e14d3c304a20a4edb25278bb8c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:50:18Z,use_quota=True,user_id='c025f9017b9b4c1bbce13382abcad405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Creating volume b3aab50c-d36b-4e85-bcaf-71ea5debb671 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:50:18 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:18 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671 1073741824 Jul 05 02:50:18 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:18 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ec44a3cc-9954-4559-92d0-d52e1661391a" returned: 0 in 0.862s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-quobyte-ec44a3cc-9954-4559-92d0-d52e1661391a" released by "delete_volume" :: held 2.863s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:18 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Created reservations ['137d8301-3039-4fd3-b6d8-245d66a03877', 'bf55f5fc-de8b-456e-9e95-90a7023558d5', 'b6f7d5e5-82f9-4a75-874b-f56ac2df67e5', '055fe369-18a8-4cf9-a2ce-cb2c8c6d099c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:19 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:50:19 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:19 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671 1073741824" returned: 0 in 1.003s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:19 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671 Jul 05 02:50:19 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:19 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.766s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:50:19 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Deleted volume successfully. Jul 05 02:50:19 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-a1177c89-1765-43b1-873d-bb101ca5bbbf req-77324068-a3bf-43a8-99a5-67a964a3a61a tempest-TestInstancesWithCinderVolumes-1617454047 None] Terminate volume connection completed successfully. Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-a1177c89-1765-43b1-873d-bb101ca5bbbf req-77324068-a3bf-43a8-99a5-67a964a3a61a tempest-TestInstancesWithCinderVolumes-1617454047 None] Deleting attachment 70f164e4-0a79-488d-afd5-1cb4645909d2. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8a1e59cb-8579-4637-a3f1-929c304f5361 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-ec44a3cc-9954-4559-92d0-d52e1661391a-delete_volume" released by "delete_volume" :: held 3.857s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Flow 'volume_create_manager' (f1f7c1fb-af39-4eba-a635-7360a8a4dbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba36a48-c40f-4916-b5db-71933dc6d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba36a48-c40f-4916-b5db-71933dc6d920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-831798691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00af8032-b559-401e-a20f-abc1e76b30ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af1f6ce88ed471e8a9425bd417eaab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:50:20Z,use_quota=True,user_id='eb832431f3644beab29997a643a7bea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a4ed6e5-c41f-43b1-bce7-359b86f7ea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a4ed6e5-c41f-43b1-bce7-359b86f7ea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5c8c72-f9b4-4ed2-a12f-ccfb5a82de52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5c8c72-f9b4-4ed2-a12f-ccfb5a82de52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00af8032-b559-401e-a20f-abc1e76b30ba', 'volume_name': 'volume-00af8032-b559-401e-a20f-abc1e76b30ba', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31406b7-d3da-4eac-95c1-b385386d3ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31406b7-d3da-4eac-95c1-b385386d3ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5c1a43-5fa1-47a1-9398-8021509cd0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:19 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Volume 00af8032-b559-401e-a20f-abc1e76b30ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00af8032-b559-401e-a20f-abc1e76b30ba', 'volume_size': 1} Jul 05 02:50:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:20 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671" returned: 0 in 0.767s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.212s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-831798691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00af8032-b559-401e-a20f-abc1e76b30ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af1f6ce88ed471e8a9425bd417eaab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:50:20Z,use_quota=True,user_id='eb832431f3644beab29997a643a7bea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Creating volume 00af8032-b559-401e-a20f-abc1e76b30ba {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:50:20 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:20 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba 1073741824 Jul 05 02:50:20 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7010d41-ee20-4431-8b40-97bc628bb31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eb0fcf-2b6b-4226-82d9-9ddcf3994364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:20 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Volume volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671 (b3aab50c-d36b-4e85-bcaf-71ea5debb671): created successfully Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94eb0fcf-2b6b-4226-82d9-9ddcf3994364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Flow 'volume_create_manager' (b23b97c4-1e1a-4ae3-a5eb-fb838eb8a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:50:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5e9c4f06-946d-4896-81be-fda0a97b0d59 tempest-VolumesMetadataTest-1018289594 None] Created volume successfully. Jul 05 02:50:21 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba 1073741824" returned: 0 in 0.833s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:21 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba Jul 05 02:50:21 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:21 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba" returned: 0 in 0.671s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:50:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5c1a43-5fa1-47a1-9398-8021509cd0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00af8032-b559-401e-a20f-abc1e76b30ba', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d9f49b-e08a-441e-b7f9-317c87c2dbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:21 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Volume volume-00af8032-b559-401e-a20f-abc1e76b30ba (00af8032-b559-401e-a20f-abc1e76b30ba): created successfully Jul 05 02:50:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d9f49b-e08a-441e-b7f9-317c87c2dbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Flow 'volume_create_manager' (f1f7c1fb-af39-4eba-a635-7360a8a4dbb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:50:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-484f3a9e-4071-43b1-b588-2d3365082c50 tempest-VolumesExtendTest-2051439708 None] Created volume successfully. Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Acquiring lock "cinder-b3aab50c-d36b-4e85-bcaf-71ea5debb671-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Lock "cinder-b3aab50c-d36b-4e85-bcaf-71ea5debb671-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Acquiring lock "cinder-quobyte-b3aab50c-d36b-4e85-bcaf-71ea5debb671" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Lock "cinder-quobyte-b3aab50c-d36b-4e85-bcaf-71ea5debb671" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[350c6c25-316c-48d0-bb21-180b3d8d8546]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Creating offline snapshot 82723ae5-7c4e-42ef-9eb1-dc9910b57b60 of volume 00af8032-b559-401e-a20f-abc1e76b30ba {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a643c10b-3c91-429d-b356-9edeb987f2f0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:22 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671 Jul 05 02:50:22 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:22 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba Jul 05 02:50:22 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:22 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671" returned: 0 in 0.790s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:22 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:22 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671 Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba" returned: 0 in 0.742s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:22 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:23 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 1G Jul 05 02:50:23 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "cinder-ba99be1c-7b96-4086-a59d-23d3267f528f-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-ba99be1c-7b96-4086-a59d-23d3267f528f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "cinder-quobyte-ba99be1c-7b96-4086-a59d-23d3267f528f" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-quobyte-ba99be1c-7b96-4086-a59d-23d3267f528f" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a8278b-6828-4197-9661-f231149cf61f]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:23 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f Jul 05 02:50:23 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:23 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b3aab50c-d36b-4e85-bcaf-71ea5debb671" returned: 0 in 0.707s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Lock "cinder-quobyte-b3aab50c-d36b-4e85-bcaf-71ea5debb671" released by "delete_volume" :: held 1.539s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Created reservations ['564e76cc-7640-476b-83c7-a851182bc877', 'c9c96eb9-116e-4168-8d78-525d3edf7bbf', '133fcea2-7506-4931-8a29-94c3fd16cb0c', '4e081fdb-4983-46c8-8e77-0ae8b712713e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:23 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:50:23 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:23 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 1G" returned: 0 in 0.922s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00af8032-b559-401e-a20f-abc1e76b30ba -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:23 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00af8032-b559-401e-a20f-abc1e76b30ba -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 Jul 05 02:50:23 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:24 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f" returned: 0 in 0.835s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:24 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f Jul 05 02:50:24 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:24 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.669s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:24 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:50:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Deleted volume successfully. Jul 05 02:50:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-180bdcf5-795b-4fdd-bed5-e073d1403d81 tempest-VolumesMetadataTest-1018289594 None] Lock "cinder-b3aab50c-d36b-4e85-bcaf-71ea5debb671-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:24 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00af8032-b559-401e-a20f-abc1e76b30ba -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60" returned: 0 in 0.756s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:24 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 is being set with open permissions: ugo+rw Jul 05 02:50:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:24 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 Jul 05 02:50:24 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:24 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f" returned: 1 in 0.827s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:50:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:24 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f Jul 05 02:50:24 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:25 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60" returned: 0 in 0.721s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:25 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.info Jul 05 02:50:25 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:25 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ba99be1c-7b96-4086-a59d-23d3267f528f" returned: 0 in 0.811s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-quobyte-ba99be1c-7b96-4086-a59d-23d3267f528f" released by "delete_volume" :: held 2.552s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:25 devstack cinder-volume[86671]: WARNING cinder.quota [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1049506662-1601112016 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1049506662-1601112016, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:50:25 devstack cinder-volume[86671]: WARNING cinder.quota [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1049506662-1601112016 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1049506662-1601112016, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Created reservations ['4b289300-8151-43c2-b811-31ccb3aaa140', '4392ad45-0cef-4313-b0e0-4f1592f5dbdd', '469f2e1f-8290-4b31-8def-eba5ffc80262', '51b4dc39-6df5-4d92-b611-d3b98a0c2d33'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:25 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:50:25 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:26 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.info" returned: 0 in 0.759s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:26 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.info is being set with open permissions: ugo+rw Jul 05 02:50:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:26 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.info Jul 05 02:50:26 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:26 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.714s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:26 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:50:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Deleted volume successfully. Jul 05 02:50:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bdbf19ab-e99d-449b-b97d-54fc875ee3ae tempest-TestInstancesWithCinderVolumes-1617454047 None] Lock "cinder-ba99be1c-7b96-4086-a59d-23d3267f528f-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:26 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.info" returned: 0 in 0.694s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.697s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2ba75beb-189e-4890-9495-db9d2a054f0c tempest-VolumesExtendTest-2051439708 None] Create snapshot completed successfully Jul 05 02:50:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6b7739a3-a4c3-4099-bb69-95bae79369ff tempest-VolumesExtendTest-2051439708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6b7739a3-a4c3-4099-bb69-95bae79369ff tempest-VolumesExtendTest-2051439708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:27 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c34c95-b793-480c-8128-9caeaf92bb85]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6b7739a3-a4c3-4099-bb69-95bae79369ff tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:27 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba Jul 05 02:50:27 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:28 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6b7739a3-a4c3-4099-bb69-95bae79369ff tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba" returned: 0 in 0.899s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6b7739a3-a4c3-4099-bb69-95bae79369ff tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 2G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6b7739a3-a4c3-4099-bb69-95bae79369ff tempest-VolumesExtendTest-2051439708 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 2G" returned: 0 in 0.165s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6b7739a3-a4c3-4099-bb69-95bae79369ff tempest-VolumesExtendTest-2051439708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.104s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:28 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=104,cinder:SELECT=81,cinder:INSERT=27,cinder:DELETE=7 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:50:28 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6b7739a3-a4c3-4099-bb69-95bae79369ff tempest-VolumesExtendTest-2051439708 None] Extend volume completed successfully. Jul 05 02:50:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "cinder-82723ae5-7c4e-42ef-9eb1-dc9910b57b60-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-82723ae5-7c4e-42ef-9eb1-dc9910b57b60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "cinder-quobyte-00af8032-b559-401e-a20f-abc1e76b30ba" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-quobyte-00af8032-b559-401e-a20f-abc1e76b30ba" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "cinder-quobyte-82723ae5-7c4e-42ef-9eb1-dc9910b57b60" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-quobyte-82723ae5-7c4e-42ef-9eb1-dc9910b57b60" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Deleting offline snapshot 82723ae5-7c4e-42ef-9eb1-dc9910b57b60 of volume 00af8032-b559-401e-a20f-abc1e76b30ba {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:50:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] snapshot_file for this snap is: volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:50:30 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[08750a72-aba1-4435-8f75-9b05759e062a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:30 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 Jul 05 02:50:30 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:31 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60" returned: 0 in 1.011s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00af8032-b559-401e-a20f-abc1e76b30ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:50:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f2d237-dc42-406a-821a-fe86dfcf2c10]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:31 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba Jul 05 02:50:31 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:32 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba" returned: 0 in 1.075s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:32 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 Jul 05 02:50:32 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:33 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60" returned: 0 in 0.881s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:33 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60 Jul 05 02:50:33 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:33 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba.82723ae5-7c4e-42ef-9eb1-dc9910b57b60" returned: 0 in 0.747s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-quobyte-82723ae5-7c4e-42ef-9eb1-dc9910b57b60" released by "_delete_snapshot" :: held 3.830s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-quobyte-00af8032-b559-401e-a20f-abc1e76b30ba" released by "delete_snapshot" :: held 3.861s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:33 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Created reservations ['bf9cd25d-4b44-4f22-8ff5-a4b15d760142', 'e1fb102d-6a5b-463a-b648-03a8a477a9ff', '791c1716-77d5-434c-9d11-132205cc0760', '62703f41-a65e-4ccc-a4c2-26bbce4aaf30'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:50:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Delete snapshot completed successfully. Jul 05 02:50:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1c7efa8-3fc6-41c8-8d72-b2a128140bc8 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-82723ae5-7c4e-42ef-9eb1-dc9910b57b60-delete_snapshot" released by "delete_snapshot" :: held 4.022s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "cinder-00af8032-b559-401e-a20f-abc1e76b30ba-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-00af8032-b559-401e-a20f-abc1e76b30ba-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:34 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=96,cinder:UPDATE=106,cinder:DELETE=9,cinder:INSERT=31 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:50:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "cinder-quobyte-00af8032-b559-401e-a20f-abc1e76b30ba" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:50:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-quobyte-00af8032-b559-401e-a20f-abc1e76b30ba" acquired by "delete_volume" :: waited 0.029s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:50:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7561159-db34-4066-ac84-94af51060d37]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:34 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba Jul 05 02:50:34 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:35 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba" returned: 0 in 0.991s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:35 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba Jul 05 02:50:35 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:36 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-00af8032-b559-401e-a20f-abc1e76b30ba" returned: 0 in 0.754s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-quobyte-00af8032-b559-401e-a20f-abc1e76b30ba" released by "delete_volume" :: held 1.828s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:36 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Created reservations ['8a167f9b-651a-471f-9f7c-90bf729f19f9', '35a3b1e4-e2ff-4fe7-b312-7ad422bb4087', '27c4a75a-569f-4f95-90d1-8e1273816419', '162f8bb7-a755-4813-b224-9b614d5a947e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:50:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:36 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:50:36 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:37 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.973s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:37 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:50:37 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Deleted volume successfully. Jul 05 02:50:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-66949d6f-4774-4de9-9e10-13c4ccdaf290 tempest-VolumesExtendTest-2051439708 None] Lock "cinder-00af8032-b559-401e-a20f-abc1e76b30ba-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:50:46 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=12 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:50:47 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:50:53 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:50:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Flow 'volume_create_manager' (ffba0367-d2f9-4c25-bb82-a6208c4dc73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:50:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb35144f-21f3-45ac-8db5-ae280e91aa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb35144f-21f3-45ac-8db5-ae280e91aa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1470576900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cb03cf-7d9e-4d43-abb7-ada40321790c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b9fd0ebe94861944a3f645c340095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:50:54Z,use_quota=True,user_id='86fbf35b771a40368cc022819bdb1711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1240081-15b8-405b-aeb4-673c1f6c980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1240081-15b8-405b-aeb4-673c1f6c980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31db7c79-298e-4f11-876f-73a4c4661742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31db7c79-298e-4f11-876f-73a4c4661742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3cb03cf-7d9e-4d43-abb7-ada40321790c', 'volume_name': 'volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e8fcd5-d596-4115-9be9-d4263d2a3874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e8fcd5-d596-4115-9be9-d4263d2a3874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91bf969-f9db-46f5-8ad1-b176156f06e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:54 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Volume a3cb03cf-7d9e-4d43-abb7-ada40321790c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c', 'volume_size': 1} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1470576900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3cb03cf-7d9e-4d43-abb7-ada40321790c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b9fd0ebe94861944a3f645c340095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:50:54Z,use_quota=True,user_id='86fbf35b771a40368cc022819bdb1711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Creating volume a3cb03cf-7d9e-4d43-abb7-ada40321790c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:50:54 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:50:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:54 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c 1073741824 Jul 05 02:50:54 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:55 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c 1073741824" returned: 0 in 0.959s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:55 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c Jul 05 02:50:55 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:56 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c" returned: 0 in 0.957s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:50:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:50:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91bf969-f9db-46f5-8ad1-b176156f06e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40bec03-5986-4425-b139-385188c3726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:50:56 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Volume volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c (a3cb03cf-7d9e-4d43-abb7-ada40321790c): created successfully Jul 05 02:50:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40bec03-5986-4425-b139-385188c3726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:50:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Flow 'volume_create_manager' (ffba0367-d2f9-4c25-bb82-a6208c4dc73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:50:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d9ca1c47-1d2a-4d41-8290-c969713f2625 tempest-VolumesSnapshotTestJSON-996360390 None] Created volume successfully. Jul 05 02:50:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:50:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:50:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Creating offline snapshot cda1c77d-d2bd-41c5-b02f-58b76d1d7730 of volume a3cb03cf-7d9e-4d43-abb7-ada40321790c {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:50:57 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[25388b29-d159-4c94-ac9c-f99636446960]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:50:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:57 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c Jul 05 02:50:57 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:58 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c" returned: 0 in 0.941s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:58 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 1G Jul 05 02:50:58 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:50:59 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 05 02:50:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 1G" returned: 0 in 0.934s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:50:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:50:59 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 Jul 05 02:50:59 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:00 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730" returned: 0 in 0.758s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:00 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 is being set with open permissions: ugo+rw Jul 05 02:51:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:00 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 Jul 05 02:51:00 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:00 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730" returned: 0 in 0.710s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:00 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.info Jul 05 02:51:00 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:01 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.info" returned: 0 in 0.837s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:01 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.info is being set with open permissions: ugo+rw Jul 05 02:51:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:01 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.info Jul 05 02:51:01 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:02 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.info" returned: 0 in 0.933s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.284s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:02 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b689345f-3a1f-42f3-a040-95b8a1cf8d60 tempest-VolumesSnapshotTestJSON-996360390 None] Create snapshot completed successfully Jul 05 02:51:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-cda1c77d-d2bd-41c5-b02f-58b76d1d7730-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-cda1c77d-d2bd-41c5-b02f-58b76d1d7730-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-a3cb03cf-7d9e-4d43-abb7-ada40321790c" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-a3cb03cf-7d9e-4d43-abb7-ada40321790c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-cda1c77d-d2bd-41c5-b02f-58b76d1d7730" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-cda1c77d-d2bd-41c5-b02f-58b76d1d7730" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Deleting offline snapshot cda1c77d-d2bd-41c5-b02f-58b76d1d7730 of volume a3cb03cf-7d9e-4d43-abb7-ada40321790c {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] snapshot_file for this snap is: volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b22ef0-460c-4661-9052-d843c34ed846]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:04 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 Jul 05 02:51:04 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:04 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730" returned: 0 in 0.814s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9333d95-4c1c-4b25-920e-2f1ba8a589a0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:05 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c Jul 05 02:51:05 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:05 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:51:05 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:05 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c" returned: 0 in 0.862s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:05 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 Jul 05 02:51:05 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:05 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.708s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:51:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:51:06 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730" returned: 0 in 0.979s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:06 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730 Jul 05 02:51:06 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:07 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c.cda1c77d-d2bd-41c5-b02f-58b76d1d7730" returned: 0 in 0.848s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-cda1c77d-d2bd-41c5-b02f-58b76d1d7730" released by "_delete_snapshot" :: held 3.644s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-a3cb03cf-7d9e-4d43-abb7-ada40321790c" released by "delete_snapshot" :: held 3.673s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:07 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Created reservations ['c31c42c9-9a83-46d1-8558-541257fc42e9', 'c20ab67c-711b-46fb-a001-44adcbd89734', '4219ec88-fe5a-4962-8986-139b5affc224', '9f6e8710-a287-4656-8f99-802262527f3e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:51:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Delete snapshot completed successfully. Jul 05 02:51:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-866318e1-7475-40a6-b5a7-853949f20420 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-cda1c77d-d2bd-41c5-b02f-58b76d1d7730-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Flow 'volume_create_manager' (c1cd34a3-c4f7-479a-8096-e44d73d2855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2254e70-c435-41f0-8d03-1ba3ca192f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2254e70-c435-41f0-8d03-1ba3ca192f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-667295029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b9fd0ebe94861944a3f645c340095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:51:09Z,use_quota=True,user_id='86fbf35b771a40368cc022819bdb1711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1dc919a-f2ad-4627-aa90-1da88bf6a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1dc919a-f2ad-4627-aa90-1da88bf6a61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0978bec-eed3-4ff3-b87b-320efba5533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0978bec-eed3-4ff3-b87b-320efba5533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd', 'volume_name': 'volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150c4b2d-7ea3-40aa-a6a4-1554289ac5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150c4b2d-7ea3-40aa-a6a4-1554289ac5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebd4177-6abb-4094-b575-334731a6be4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:09 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Volume c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd', 'volume_size': 1} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-667295029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b9fd0ebe94861944a3f645c340095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:51:09Z,use_quota=True,user_id='86fbf35b771a40368cc022819bdb1711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Creating volume c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:51:09 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:51:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:09 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd 1073741824 Jul 05 02:51:09 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:10 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd 1073741824" returned: 0 in 1.404s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:10 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd Jul 05 02:51:10 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:11 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" returned: 0 in 0.910s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] <== create_volume: return (2379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:51:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.383s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebd4177-6abb-4094-b575-334731a6be4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65a40c5-b20d-42e4-b6d5-2f6d427b6f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Volume volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd (c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd): created successfully Jul 05 02:51:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65a40c5-b20d-42e4-b6d5-2f6d427b6f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Flow 'volume_create_manager' (c1cd34a3-c4f7-479a-8096-e44d73d2855f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-bd832ece-4651-44cc-85bd-13564c029a57 tempest-VolumesSnapshotTestJSON-996360390 None] Created volume successfully. Jul 05 02:51:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Creating offline snapshot ee87bc4a-9239-4b51-94f4-49263ff165fa of volume c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:51:12 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffa3e5a-6680-4218-9292-7d89c9fc8f59]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:13 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd Jul 05 02:51:13 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:14 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" returned: 0 in 1.328s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:14 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa 1G Jul 05 02:51:14 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:15 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa 1G" returned: 0 in 1.290s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:15 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa Jul 05 02:51:15 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:16 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa" returned: 0 in 0.939s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:16 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa is being set with open permissions: ugo+rw Jul 05 02:51:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:16 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa Jul 05 02:51:16 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:17 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa" returned: 0 in 0.712s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:17 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.info Jul 05 02:51:17 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Flow 'volume_create_manager' (08a05ed5-b388-42d7-845c-e807a1573f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13810054-19e1-4c2b-b232-384b934fdc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13810054-19e1-4c2b-b232-384b934fdc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-197391721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c61167-067c-42c5-8581-fcc5151425be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e1a94b10604fd8b91369d07de978cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:51:18Z,use_quota=True,user_id='22bb24ad1be143f1815263f5452943f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b371f5-3808-4745-907d-5ab64668a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9b371f5-3808-4745-907d-5ab64668a955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d538ab2b-d506-475d-af79-5cf806d2f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d538ab2b-d506-475d-af79-5cf806d2f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c61167-067c-42c5-8581-fcc5151425be', 'volume_name': 'volume-c3c61167-067c-42c5-8581-fcc5151425be', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58813d9-92bc-4fad-bbf8-c73ee0931758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58813d9-92bc-4fad-bbf8-c73ee0931758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac1ea77-ba42-4dc8-8ff9-d3ec4b0d7909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:17 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Volume c3c61167-067c-42c5-8581-fcc5151425be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c61167-067c-42c5-8581-fcc5151425be', 'volume_size': 1} Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:17 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.info" returned: 0 in 0.771s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:17 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.info is being set with open permissions: ugo+rw Jul 05 02:51:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:17 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.info Jul 05 02:51:17 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:18 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.info" returned: 0 in 0.742s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.928s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-197391721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c61167-067c-42c5-8581-fcc5151425be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e1a94b10604fd8b91369d07de978cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:51:18Z,use_quota=True,user_id='22bb24ad1be143f1815263f5452943f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Creating volume c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:51:18 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:51:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:18 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be 1073741824 Jul 05 02:51:18 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-88bfa914-dd6c-4110-8405-3762256d5a21 tempest-VolumesSnapshotTestJSON-996360390 None] Create snapshot completed successfully Jul 05 02:51:19 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be 1073741824" returned: 0 in 1.022s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:19 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be Jul 05 02:51:19 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Flow 'volume_create_manager' (f22d2274-972a-4e0c-b6b3-b4477fadaa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bc0553-6852-45f6-bc89-0ad941858a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bc0553-6852-45f6-bc89-0ad941858a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2027272020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6110ff-8978-4545-8df5-981a18b1010e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b9fd0ebe94861944a3f645c340095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:51:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ee87bc4a-9239-4b51-94f4-49263ff165fa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:51:20Z,use_quota=True,user_id='86fbf35b771a40368cc022819bdb1711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747c98cf-2d73-4dc2-ad75-b2984fab0e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747c98cf-2d73-4dc2-ad75-b2984fab0e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10010bec-d901-4e92-9a71-7c013d7e74b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10010bec-d901-4e92-9a71-7c013d7e74b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ff6110ff-8978-4545-8df5-981a18b1010e', 'volume_name': 'volume-ff6110ff-8978-4545-8df5-981a18b1010e', 'volume_size': 2, 'snapshot_id': 'ee87bc4a-9239-4b51-94f4-49263ff165fa'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d31603-caf0-4ae2-aef0-77a31981996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d31603-caf0-4ae2-aef0-77a31981996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7bf490-8c89-4877-a64b-aafd45c306bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:19 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Volume ff6110ff-8978-4545-8df5-981a18b1010e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ff6110ff-8978-4545-8df5-981a18b1010e', 'volume_size': 2, 'snapshot_id': 'ee87bc4a-9239-4b51-94f4-49263ff165fa'} Jul 05 02:51:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:20 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be" returned: 0 in 0.689s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.534s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-ee87bc4a-9239-4b51-94f4-49263ff165fa-ff6110ff-8978-4545-8df5-981a18b1010e" by "_create_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac1ea77-ba42-4dc8-8ff9-d3ec4b0d7909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c61167-067c-42c5-8581-fcc5151425be', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b1444e-4c3c-4794-8f33-253af73f0b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-ee87bc4a-9239-4b51-94f4-49263ff165fa-ff6110ff-8978-4545-8df5-981a18b1010e" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Creating volume ff6110ff-8978-4545-8df5-981a18b1010e from snapshot ee87bc4a-9239-4b51-94f4-49263ff165fa {{(pid=86671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-ff6110ff-8978-4545-8df5-981a18b1010e" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:20 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Volume volume-c3c61167-067c-42c5-8581-fcc5151425be (c3c61167-067c-42c5-8581-fcc5151425be): created successfully Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b1444e-4c3c-4794-8f33-253af73f0b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Flow 'volume_create_manager' (08a05ed5-b388-42d7-845c-e807a1573f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-ff6110ff-8978-4545-8df5-981a18b1010e" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] snapshot: ee87bc4a-9239-4b51-94f4-49263ff165fa, volume: ff6110ff-8978-4545-8df5-981a18b1010e, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f6c76e32-558c-4d25-8a7c-993cb0d91f05 tempest-TestStampPattern-1822824796 None] Created volume successfully. Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e535cdd-4a17-41a7-94f5-0eb5ffa551f5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:20 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa Jul 05 02:51:20 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:21 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa" returned: 0 in 0.835s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:51:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:51:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:51:21 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55b1fda-6682-4f17-bdcc-3e4aaddbe899]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:21 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd Jul 05 02:51:21 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:22 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" returned: 0 in 0.786s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:22 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:51:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:22 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e Jul 05 02:51:22 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:27 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e" returned: 0 in 5.654s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:27 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e2192b-2a9f-4433-84ad-c62afef5c642]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:28 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd Jul 05 02:51:28 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:28 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" returned: 0 in 0.946s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:28 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:51:28 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Converted 1024.00 MB image at 181.08 MB/s Jul 05 02:51:28 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e is being set with open permissions: ugo+rw Jul 05 02:51:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:28 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e Jul 05 02:51:28 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:29 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e" returned: 0 in 0.674s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-ff6110ff-8978-4545-8df5-981a18b1010e" released by "_copy_volume_from_snapshot" :: held 9.025s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-ee87bc4a-9239-4b51-94f4-49263ff165fa-ff6110ff-8978-4545-8df5-981a18b1010e" released by "_create_volume_from_snapshot" :: held 9.082s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.124s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7bf490-8c89-4877-a64b-aafd45c306bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6110ff-8978-4545-8df5-981a18b1010e', 'volume_size': 2, 'snapshot_id': 'ee87bc4a-9239-4b51-94f4-49263ff165fa'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e4300f-e469-4f46-b1ff-5f6e08fd377b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:29 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Volume volume-ff6110ff-8978-4545-8df5-981a18b1010e (ff6110ff-8978-4545-8df5-981a18b1010e): created successfully Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e4300f-e469-4f46-b1ff-5f6e08fd377b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Flow 'volume_create_manager' (f22d2274-972a-4e0c-b6b3-b4477fadaa4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-fa566c81-fd31-46d1-9424-d101512d7446 tempest-VolumesSnapshotTestJSON-996360390 None] Created volume successfully. Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-ff6110ff-8978-4545-8df5-981a18b1010e-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-ff6110ff-8978-4545-8df5-981a18b1010e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-ff6110ff-8978-4545-8df5-981a18b1010e" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-ff6110ff-8978-4545-8df5-981a18b1010e" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e97e972-1be3-4184-ba9f-3e128b16c2a1]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:30 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e Jul 05 02:51:30 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:30 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e" returned: 0 in 0.952s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:30 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e Jul 05 02:51:30 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:31 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ff6110ff-8978-4545-8df5-981a18b1010e" returned: 0 in 0.988s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-ff6110ff-8978-4545-8df5-981a18b1010e" released by "delete_volume" :: held 1.979s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:31 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Created reservations ['98a48c27-5e47-4027-be37-fd359d82a7a5', 'dc048f24-5599-4626-958c-cdb14e9e3089', '74e213b3-9186-42a6-b3ee-142be9a8b64b', '5969d671-6263-44e0-afdd-f71d0b40128a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:32 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:51:32 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-ee87bc4a-9239-4b51-94f4-49263ff165fa-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-ee87bc4a-9239-4b51-94f4-49263ff165fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-ee87bc4a-9239-4b51-94f4-49263ff165fa" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-ee87bc4a-9239-4b51-94f4-49263ff165fa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Deleting offline snapshot ee87bc4a-9239-4b51-94f4-49263ff165fa of volume c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] snapshot_file for this snap is: volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a246366-10c5-4fe9-a71e-a2a4bece23bf]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:32 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa Jul 05 02:51:32 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:32 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.689s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:51:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Deleted volume successfully. Jul 05 02:51:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-42bd1c83-c074-469d-a95f-201bc1823129 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-ff6110ff-8978-4545-8df5-981a18b1010e-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:33 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa" returned: 0 in 0.822s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:51:33 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0fc2eb-1760-4911-b6e9-be0117ce51ea]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:33 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd Jul 05 02:51:33 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:33 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" returned: 0 in 0.789s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:33 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa Jul 05 02:51:33 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:34 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa" returned: 0 in 0.862s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:34 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa Jul 05 02:51:34 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:35 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd.ee87bc4a-9239-4b51-94f4-49263ff165fa" returned: 0 in 0.839s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Flow 'volume_create_manager' (48c726fd-fbf3-4131-97c7-ba12ad1a4d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9ad242-73e9-44a5-9035-37f10f4b2a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9ad242-73e9-44a5-9035-37f10f4b2a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1887799427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be62b0af5d5b4725a596130e719f0304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:51:36Z,use_quota=True,user_id='24d3c5a8d76b4162a6353bbd8e5b9d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45df4ff5-8942-4f5a-a4f8-b4f48baa474e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45df4ff5-8942-4f5a-a4f8-b4f48baa474e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0b9d81-354d-4254-b2b9-bd25204eca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a0b9d81-354d-4254-b2b9-bd25204eca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef', 'volume_name': 'volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062809d1-2346-4cf2-8d24-3262d80ac9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062809d1-2346-4cf2-8d24-3262d80ac9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa703d35-ca73-4252-a1ca-ce254a36a40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:35 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Volume 42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef', 'volume_size': 1} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1887799427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be62b0af5d5b4725a596130e719f0304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:51:36Z,use_quota=True,user_id='24d3c5a8d76b4162a6353bbd8e5b9d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Creating volume 42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:51:35 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-ee87bc4a-9239-4b51-94f4-49263ff165fa" released by "_delete_snapshot" :: held 3.545s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" released by "delete_snapshot" :: held 3.576s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:35 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef 1073741824 Jul 05 02:51:35 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Created reservations ['455150d5-fc59-43a3-ae42-f4e65a619c97', '92c13e9f-ab28-47e3-a5f4-d9ff91fbe27c', '458d4073-4ad0-4a43-a31e-969704c568dc', '35bb1a52-cafa-4444-8137-771cd2dfae89'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:51:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Delete snapshot completed successfully. Jul 05 02:51:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b9b97542-34d7-445e-848d-4f3edde43c8b tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-ee87bc4a-9239-4b51-94f4-49263ff165fa-delete_snapshot" released by "delete_snapshot" :: held 3.727s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:36 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dcaf2d-4571-48d4-a0dd-6af769aadfac]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:36 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef 1073741824" returned: 0 in 1.074s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:36 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd Jul 05 02:51:36 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:36 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef Jul 05 02:51:36 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:37 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:37 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef" returned: 0 in 0.804s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:51:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" returned: 0 in 0.948s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa703d35-ca73-4252-a1ca-ce254a36a40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:37 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd Jul 05 02:51:37 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa17527c-8b72-4121-a248-128877be3c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:37 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Volume volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef (42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef): created successfully Jul 05 02:51:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa17527c-8b72-4121-a248-128877be3c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Flow 'volume_create_manager' (48c726fd-fbf3-4131-97c7-ba12ad1a4d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:37 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3161b7b5-42e7-41d4-a57f-8e462c73af2c tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Created volume successfully. Jul 05 02:51:38 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" returned: 0 in 0.758s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd" released by "delete_volume" :: held 1.790s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:38 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Created reservations ['6a5ba4e0-d85c-4620-b394-a0d9b105d683', 'fb363b2f-04aa-44de-8e7d-706605e7beed', 'f8061999-c8d6-4429-ae95-eb2fc691fc29', '3f6caf7e-2634-416a-90eb-cef0ada0b782'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:51:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:38 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:51:38 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:39 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.890s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:51:39 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Deleted volume successfully. Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5748e2ff-219f-480a-a67d-a1badc780dce tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-c0dafd63-a3d2-4df0-b5dc-0d651b0ecabd-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Flow 'volume_create_manager' (24e4e88c-b914-4174-ba3f-8e789a6a286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbde089-2165-4ad2-b2da-722194bfd674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbde089-2165-4ad2-b2da-722194bfd674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1500722468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b26bdc-71bf-4ac2-974f-ffbf175a8826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b9fd0ebe94861944a3f645c340095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:51:40Z,use_quota=True,user_id='86fbf35b771a40368cc022819bdb1711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d5ceed-fdbe-4a60-ae48-d232e2864208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d5ceed-fdbe-4a60-ae48-d232e2864208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ff09e1-fb6d-49fd-8fb1-c1b8138575f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ff09e1-fb6d-49fd-8fb1-c1b8138575f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b26bdc-71bf-4ac2-974f-ffbf175a8826', 'volume_name': 'volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470f0ffb-fce6-4825-b898-4cff02715d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470f0ffb-fce6-4825-b898-4cff02715d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3656ce44-f6b8-40ed-85fd-b231882b96a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:39 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Volume d3b26bdc-71bf-4ac2-974f-ffbf175a8826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826', 'volume_size': 1} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1500722468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b26bdc-71bf-4ac2-974f-ffbf175a8826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b9fd0ebe94861944a3f645c340095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:51:40Z,use_quota=True,user_id='86fbf35b771a40368cc022819bdb1711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Creating volume d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:51:39 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:51:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:39 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 1073741824 Jul 05 02:51:39 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:40 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 1073741824" returned: 0 in 0.870s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:40 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 Jul 05 02:51:40 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:41 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" returned: 0 in 0.640s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3656ce44-f6b8-40ed-85fd-b231882b96a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568171f9-79b9-4fe2-88eb-a00b9b5926fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:41 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Volume volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 (d3b26bdc-71bf-4ac2-974f-ffbf175a8826): created successfully Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (568171f9-79b9-4fe2-88eb-a00b9b5926fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Flow 'volume_create_manager' (24e4e88c-b914-4174-ba3f-8e789a6a286a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:41 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-bd29653a-ae0c-417c-aeff-db8a14c51ae0 tempest-VolumesSnapshotTestJSON-996360390 None] Created volume successfully. Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Creating offline snapshot 783cb1b5-3732-49bd-934f-73a6a370419b of volume d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6065f69-5660-469c-b15d-099906755181]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-60e646fc-01a5-4b1b-acd3-5d6f8f72a7d7 req-091d7c86-51b6-48e9-9755-3a35cc783e79 tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:42 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 Jul 05 02:51:42 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:42 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" returned: 0 in 0.761s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:42 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b 1G Jul 05 02:51:42 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:43 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b 1G" returned: 0 in 0.840s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:43 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b Jul 05 02:51:43 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:44 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b" returned: 0 in 0.734s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:44 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b is being set with open permissions: ugo+rw Jul 05 02:51:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:44 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b Jul 05 02:51:44 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:44 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b" returned: 0 in 0.662s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:45 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.info Jul 05 02:51:45 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:45 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.info" returned: 0 in 0.668s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:45 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.info is being set with open permissions: ugo+rw Jul 05 02:51:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:45 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.info Jul 05 02:51:45 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:46 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.info" returned: 0 in 0.682s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.437s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-60e646fc-01a5-4b1b-acd3-5d6f8f72a7d7 req-091d7c86-51b6-48e9-9755-3a35cc783e79 tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.375s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5d61d9-72ed-4d0e-aacf-a046dc5ed036]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-60e646fc-01a5-4b1b-acd3-5d6f8f72a7d7 req-091d7c86-51b6-48e9-9755-3a35cc783e79 tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:46 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5f4e3d75-4402-46ac-9a01-e2381e08d26e tempest-VolumesSnapshotTestJSON-996360390 None] Create snapshot completed successfully Jul 05 02:51:46 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef Jul 05 02:51:46 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:47 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-60e646fc-01a5-4b1b-acd3-5d6f8f72a7d7 req-091d7c86-51b6-48e9-9755-3a35cc783e79 tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef" returned: 0 in 0.775s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-60e646fc-01a5-4b1b-acd3-5d6f8f72a7d7 req-091d7c86-51b6-48e9-9755-3a35cc783e79 tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.791s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=55,cinder:UPDATE=47,cinder:DELETE=5,cinder:INSERT=10 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-60e646fc-01a5-4b1b-acd3-5d6f8f72a7d7 req-091d7c86-51b6-48e9-9755-3a35cc783e79 tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64942b4b-dcdf-4748-a2df-e986f39c535f', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:51:47 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-60e646fc-01a5-4b1b-acd3-5d6f8f72a7d7 req-091d7c86-51b6-48e9-9755-3a35cc783e79 tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] attachment_update completed successfully. Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=55,cinder:UPDATE=54,cinder:INSERT=14,cinder:DELETE=6 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Flow 'volume_create_manager' (f5fb950f-4d1f-4f1b-8c2e-0036ced3a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cec0853-19f9-420d-bdae-85f03ac4b7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cec0853-19f9-420d-bdae-85f03ac4b7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1936818318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a22fbc3-a6a9-4cfa-8454-70dffed222d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b9fd0ebe94861944a3f645c340095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=783cb1b5-3732-49bd-934f-73a6a370419b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:51:48Z,use_quota=True,user_id='86fbf35b771a40368cc022819bdb1711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2205e30b-3f8e-4896-8ae9-4be91cf9ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2205e30b-3f8e-4896-8ae9-4be91cf9ada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a2bbc7-25e2-4952-859c-dc5946c15dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a2bbc7-25e2-4952-859c-dc5946c15dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a22fbc3-a6a9-4cfa-8454-70dffed222d6', 'volume_name': 'volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6', 'volume_size': 1, 'snapshot_id': '783cb1b5-3732-49bd-934f-73a6a370419b'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a5d881-41a1-473f-b7c7-d619ca477427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a5d881-41a1-473f-b7c7-d619ca477427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad959cc1-55dc-418d-8883-d7653de3b1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:47 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Volume 2a22fbc3-a6a9-4cfa-8454-70dffed222d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6', 'volume_size': 1, 'snapshot_id': '783cb1b5-3732-49bd-934f-73a6a370419b'} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-783cb1b5-3732-49bd-934f-73a6a370419b-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" by "_create_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-783cb1b5-3732-49bd-934f-73a6a370419b-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Creating volume 2a22fbc3-a6a9-4cfa-8454-70dffed222d6 from snapshot 783cb1b5-3732-49bd-934f-73a6a370419b {{(pid=86671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] snapshot: 783cb1b5-3732-49bd-934f-73a6a370419b, volume: 2a22fbc3-a6a9-4cfa-8454-70dffed222d6, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff9fcf-ea75-4559-ae5e-06c2d3e097c0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:47 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b Jul 05 02:51:47 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:48 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b" returned: 0 in 0.765s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:51:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:51:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:51:48 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30ef5a1-9409-484e-b617-434383336da7]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:48 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 Jul 05 02:51:48 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:49 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" returned: 0 in 0.742s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:49 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:51:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:49 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 Jul 05 02:51:49 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:54 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" returned: 0 in 5.288s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:54 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd81accc-e330-4454-9520-ffd0c5d780d6]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:54 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 Jul 05 02:51:54 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:55 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" returned: 0 in 0.937s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:55 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:51:55 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Converted 1024.00 MB image at 193.59 MB/s Jul 05 02:51:55 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 is being set with open permissions: ugo+rw Jul 05 02:51:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:55 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 Jul 05 02:51:55 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-7d4fa154-b7cb-4dfa-bc3b-6d6cbf5c2e19 req-9f7433c4-2181-4042-b1d6-a1807e45be3d tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Terminate volume connection completed successfully. Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-7d4fa154-b7cb-4dfa-bc3b-6d6cbf5c2e19 req-9f7433c4-2181-4042-b1d6-a1807e45be3d tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Deleting attachment 64942b4b-dcdf-4748-a2df-e986f39c535f. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:51:56 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" returned: 0 in 0.703s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" released by "_copy_volume_from_snapshot" :: held 8.521s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-783cb1b5-3732-49bd-934f-73a6a370419b-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" released by "_create_volume_from_snapshot" :: held 8.552s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.570s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad959cc1-55dc-418d-8883-d7653de3b1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6', 'volume_size': 1, 'snapshot_id': '783cb1b5-3732-49bd-934f-73a6a370419b'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d1f142-3308-4551-a53a-b7a04c419010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:51:56 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Volume volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 (2a22fbc3-a6a9-4cfa-8454-70dffed222d6): created successfully Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d1f142-3308-4551-a53a-b7a04c419010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Flow 'volume_create_manager' (f5fb950f-4d1f-4f1b-8c2e-0036ced3a953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:51:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-904a0cb2-9fe8-4638-923a-53356584444a tempest-VolumesSnapshotTestJSON-996360390 None] Created volume successfully. Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-2a22fbc3-a6a9-4cfa-8454-70dffed222d6-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-2a22fbc3-a6a9-4cfa-8454-70dffed222d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" acquired by "delete_volume" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2ccaf4-74e4-4df1-8eb3-ec8cbd84d45f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:56 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 Jul 05 02:51:56 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:57 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" returned: 0 in 0.768s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:57 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6 Jul 05 02:51:57 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:58 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" returned: 0 in 0.666s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-2a22fbc3-a6a9-4cfa-8454-70dffed222d6" released by "delete_volume" :: held 1.474s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Created reservations ['c5333cde-12cf-468c-b647-865652671c60', 'fbdeff36-5789-4f3d-babf-b49590b0fe17', '463f1707-a14c-4036-a85a-2c3b796547b7', '013a477c-8552-4084-a133-5c7e03579be6'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:58 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:51:58 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Acquiring lock "cinder-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "cinder-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Acquiring lock "cinder-quobyte-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "cinder-quobyte-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa1d82b-984b-42c0-a019-8eec26e8fa9f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:58 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef Jul 05 02:51:58 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-783cb1b5-3732-49bd-934f-73a6a370419b-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-783cb1b5-3732-49bd-934f-73a6a370419b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-783cb1b5-3732-49bd-934f-73a6a370419b" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-783cb1b5-3732-49bd-934f-73a6a370419b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Deleting offline snapshot 783cb1b5-3732-49bd-934f-73a6a370419b of volume d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] snapshot_file for this snap is: volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e2210d-66ae-47d3-aaad-2f68db1c31e0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:59 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.750s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:51:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Deleted volume successfully. Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c678f477-8c68-4d84-9e60-fce43d698752 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-2a22fbc3-a6a9-4cfa-8454-70dffed222d6-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:51:59 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b Jul 05 02:51:59 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:59 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef" returned: 0 in 0.814s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:59 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef Jul 05 02:51:59 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:59 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b" returned: 0 in 0.783s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fd4388-448c-43d6-9385-59358ae6efbc]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:51:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:51:59 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 Jul 05 02:51:59 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:51:59 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef" returned: 0 in 0.635s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "cinder-quobyte-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef" released by "delete_volume" :: held 1.503s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Created reservations ['25534f1c-31e8-4416-b147-770596302cfb', '64ef844c-c06e-4509-9ad6-5537198c9a30', 'fd7775b0-8b0f-4fe2-b3b4-5aa7ad657723', 'bd4dc2b8-3bfa-48ca-a5c9-2fd44a8ef08c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:00 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:52:00 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:00 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" returned: 0 in 0.775s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:00 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b Jul 05 02:52:00 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:00 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.667s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:52:00 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Deleted volume successfully. Jul 05 02:52:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-fbd2d1b9-a879-415e-8f74-cda1f3e4857e tempest-TestServerVolumeAttachScenarioOldVersion-193497135 None] Lock "cinder-42e7ce5e-c25c-4d25-9db8-d68c8e49d3ef-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:01 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b" returned: 0 in 0.808s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:01 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b Jul 05 02:52:01 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-01b276ae-7068-4d80-b6d6-cd3b78ab613c req-e8f796f9-ab98-4d60-b0b0-b4eb2f4abb8a tempest-TestStampPattern-1822824796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-01b276ae-7068-4d80-b6d6-cd3b78ab613c req-e8f796f9-ab98-4d60-b0b0-b4eb2f4abb8a tempest-TestStampPattern-1822824796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:01 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7572fab8-7d76-4aba-9fb8-274ec875cf9c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-01b276ae-7068-4d80-b6d6-cd3b78ab613c req-e8f796f9-ab98-4d60-b0b0-b4eb2f4abb8a tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:01 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be Jul 05 02:52:01 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:02 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826.783cb1b5-3732-49bd-934f-73a6a370419b" returned: 0 in 0.691s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-783cb1b5-3732-49bd-934f-73a6a370419b" released by "_delete_snapshot" :: held 3.200s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" released by "delete_snapshot" :: held 3.225s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:02 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Created reservations ['663c5fcd-0188-44b6-9eff-f756cd28d080', 'fe393f25-72ce-40d1-b87d-b1e9e5192541', 'da204a46-2653-4fea-89e6-31a9e3e2f1f4', '69a502b7-33e7-426f-9acb-19bf1122d349'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:52:02 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Delete snapshot completed successfully. Jul 05 02:52:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3156e587-a1ee-49e7-b9a2-a1700da5e7f6 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-783cb1b5-3732-49bd-934f-73a6a370419b-delete_snapshot" released by "delete_snapshot" :: held 3.380s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:02 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-01b276ae-7068-4d80-b6d6-cd3b78ab613c req-e8f796f9-ab98-4d60-b0b0-b4eb2f4abb8a tempest-TestStampPattern-1822824796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be" returned: 0 in 0.819s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-01b276ae-7068-4d80-b6d6-cd3b78ab613c req-e8f796f9-ab98-4d60-b0b0-b4eb2f4abb8a tempest-TestStampPattern-1822824796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.838s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-01b276ae-7068-4d80-b6d6-cd3b78ab613c req-e8f796f9-ab98-4d60-b0b0-b4eb2f4abb8a tempest-TestStampPattern-1822824796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-c3c61167-067c-42c5-8581-fcc5151425be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '891331c2-e7c0-47f0-84af-eab679d790ea', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:52:02 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-01b276ae-7068-4d80-b6d6-cd3b78ab613c req-e8f796f9-ab98-4d60-b0b0-b4eb2f4abb8a tempest-TestStampPattern-1822824796 None] attachment_update completed successfully. Jul 05 02:52:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-d3b26bdc-71bf-4ac2-974f-ffbf175a8826-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-d3b26bdc-71bf-4ac2-974f-ffbf175a8826-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:03 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6865768-b20c-499f-8fe7-8e16c05715a0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:03 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 Jul 05 02:52:03 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:04 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" returned: 0 in 0.877s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:04 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826 Jul 05 02:52:04 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:05 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" returned: 0 in 0.676s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-d3b26bdc-71bf-4ac2-974f-ffbf175a8826" released by "delete_volume" :: held 1.645s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Created reservations ['8be62dd8-2918-4fd5-a783-0e02d715c460', '80417ed7-3a98-49c8-a14e-527cf4c2e702', 'e242ee90-eb52-48cb-bde3-a6ebe9fe3a48', 'c8c0a8ab-6a85-4489-8d57-20b2f30edff3'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:05 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:52:05 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:05 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:52:05 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-a3cb03cf-7d9e-4d43-abb7-ada40321790c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-a3cb03cf-7d9e-4d43-abb7-ada40321790c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "cinder-quobyte-a3cb03cf-7d9e-4d43-abb7-ada40321790c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-a3cb03cf-7d9e-4d43-abb7-ada40321790c" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab1a6e7-a86c-4bbf-976f-8614b01f5529]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:05 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.729s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:52:05 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Deleted volume successfully. Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9b693c0e-a874-4d42-ae49-00fa50807bfb tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-d3b26bdc-71bf-4ac2-974f-ffbf175a8826-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:05 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c Jul 05 02:52:05 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:05 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.733s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:52:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:52:06 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c" returned: 0 in 0.808s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:06 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c Jul 05 02:52:06 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:07 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a3cb03cf-7d9e-4d43-abb7-ada40321790c" returned: 0 in 0.653s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-quobyte-a3cb03cf-7d9e-4d43-abb7-ada40321790c" released by "delete_volume" :: held 1.545s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:07 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Created reservations ['6c200c73-428c-414b-85ae-f38ea0754479', 'de959964-e7cd-4600-b499-2946297cd0f6', '0efe2a00-ada0-47c7-b0fb-f0b16c02c13e', '7a1bbcff-25ff-4baa-80bd-5818ea92d260'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:52:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:52:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:52:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:07 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:52:07 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:08 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.667s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:08 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:52:08 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Deleted volume successfully. Jul 05 02:52:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d6167fe-ba02-4534-b1b0-fe61ddff3f37 tempest-VolumesSnapshotTestJSON-996360390 None] Lock "cinder-a3cb03cf-7d9e-4d43-abb7-ada40321790c-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-00dd634e-6b43-4420-8e91-c4c2642dc4cd req-6141902f-6681-4869-90c4-63eac59a9429 tempest-TestStampPattern-1822824796 None] Terminate volume connection completed successfully. Jul 05 02:52:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-00dd634e-6b43-4420-8e91-c4c2642dc4cd req-6141902f-6681-4869-90c4-63eac59a9429 tempest-TestStampPattern-1822824796 None] Deleting attachment 891331c2-e7c0-47f0-84af-eab679d790ea. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:52:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Creating offline snapshot ec192b83-5c1c-406a-b3d4-48ddd816938f of volume c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:52:13 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00ad722-3956-4e8f-a30d-a9c72fbb040d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:13 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be Jul 05 02:52:13 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:14 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be" returned: 0 in 0.933s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:14 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f 1G Jul 05 02:52:14 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Flow 'volume_create_manager' (ad8f9e77-cd09-401a-8e04-65981e117071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092d738c-887c-4622-a3a8-6eab6ed69aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092d738c-887c-4622-a3a8-6eab6ed69aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-598561070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4520f036-057a-4028-8e80-2f59fb89110c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3927f6a62e542e694315e85468b0804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:52:14Z,use_quota=True,user_id='477bc8efaf5748fa918029613a5c2687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cd1d31-f290-45b7-9c1b-559ed34cf636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cd1d31-f290-45b7-9c1b-559ed34cf636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e63443-4726-4c75-991e-ccf82957f61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e63443-4726-4c75-991e-ccf82957f61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4520f036-057a-4028-8e80-2f59fb89110c', 'volume_name': 'volume-4520f036-057a-4028-8e80-2f59fb89110c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1ce58e-adcf-4ba3-abe2-251f0cca67c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1ce58e-adcf-4ba3-abe2-251f0cca67c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7771b875-7b63-479b-bc8e-e24976ab4cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:14 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Volume 4520f036-057a-4028-8e80-2f59fb89110c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4520f036-057a-4028-8e80-2f59fb89110c', 'volume_size': 1} Jul 05 02:52:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:15 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f 1G" returned: 0 in 0.842s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c61167-067c-42c5-8581-fcc5151425be -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:15 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c61167-067c-42c5-8581-fcc5151425be -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f Jul 05 02:52:15 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:15 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c61167-067c-42c5-8581-fcc5151425be -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f" returned: 0 in 0.711s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:15 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f is being set with open permissions: ugo+rw Jul 05 02:52:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:15 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f Jul 05 02:52:15 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:16 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f" returned: 0 in 0.668s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:16 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.info Jul 05 02:52:16 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:17 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.info" returned: 0 in 0.751s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:17 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.info is being set with open permissions: ugo+rw Jul 05 02:52:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:17 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.info Jul 05 02:52:17 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:18 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.info" returned: 0 in 0.682s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.746s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.446s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-598561070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4520f036-057a-4028-8e80-2f59fb89110c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3927f6a62e542e694315e85468b0804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:52:14Z,use_quota=True,user_id='477bc8efaf5748fa918029613a5c2687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Creating volume 4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:52:18 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:18 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c 1073741824 Jul 05 02:52:18 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8722129e-5e76-4f54-9981-ae33857e5960 tempest-TestStampPattern-1822824796 None] Create snapshot completed successfully Jul 05 02:52:18 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c 1073741824" returned: 0 in 0.960s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:19 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c Jul 05 02:52:19 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:19 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c" returned: 0 in 0.752s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:52:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7771b875-7b63-479b-bc8e-e24976ab4cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4520f036-057a-4028-8e80-2f59fb89110c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618217be-21ba-43d4-9c72-068cbad5306b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:19 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Volume volume-4520f036-057a-4028-8e80-2f59fb89110c (4520f036-057a-4028-8e80-2f59fb89110c): created successfully Jul 05 02:52:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618217be-21ba-43d4-9c72-068cbad5306b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Flow 'volume_create_manager' (ad8f9e77-cd09-401a-8e04-65981e117071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:52:19 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-371aa2ae-d8d8-47fb-845f-591580406eaa tempest-VolumesSnapshotListTestJSON-1137804043 None] Created volume successfully. Jul 05 02:52:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Creating offline snapshot 33bbe77f-de1a-4290-ac7d-a681d61fa91b of volume 4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:52:20 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[35484236-4f31-4a0d-85ee-3404e157295e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:21 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c Jul 05 02:52:21 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:21 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c" returned: 0 in 0.837s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:21 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b 1G Jul 05 02:52:21 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:22 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b 1G" returned: 0 in 0.879s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4520f036-057a-4028-8e80-2f59fb89110c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:22 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4520f036-057a-4028-8e80-2f59fb89110c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b Jul 05 02:52:22 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:23 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4520f036-057a-4028-8e80-2f59fb89110c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b" returned: 0 in 0.799s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:23 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b is being set with open permissions: ugo+rw Jul 05 02:52:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:23 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b Jul 05 02:52:23 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:24 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b" returned: 0 in 0.677s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:24 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.info Jul 05 02:52:24 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:24 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.info" returned: 0 in 0.662s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:24 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.info is being set with open permissions: ugo+rw Jul 05 02:52:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:24 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.info Jul 05 02:52:24 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:25 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.info" returned: 0 in 0.914s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.891s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:25 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-526ba6df-9493-4d72-b141-0f2f99e7e16c tempest-VolumesSnapshotListTestJSON-1137804043 None] Create snapshot completed successfully Jul 05 02:52:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] Creating offline snapshot 7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 of volume 4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:52:26 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab66bc97-d5c2-49c7-a2bd-44416a5aaee6]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:26 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b Jul 05 02:52:26 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:27 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b" returned: 0 in 0.911s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4520f036-057a-4028-8e80-2f59fb89110c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:52:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:27 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 1G Jul 05 02:52:27 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:28 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 1G" returned: 0 in 1.092s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:28 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 Jul 05 02:52:28 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Flow 'volume_create_manager' (58a86694-4c4d-4e0d-8ba3-24aad5d55138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5c8ad2-da5f-42ae-95a0-54f83ec7f00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5c8ad2-da5f-42ae-95a0-54f83ec7f00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-637333888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6785f28-db0c-43ec-a530-1d0564b0bccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e1a94b10604fd8b91369d07de978cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec192b83-5c1c-406a-b3d4-48ddd816938f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:52:29Z,use_quota=True,user_id='22bb24ad1be143f1815263f5452943f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fd18c2-3ac1-448e-a4d6-4f2f23e484e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fd18c2-3ac1-448e-a4d6-4f2f23e484e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9e849d-c6c3-48a7-9690-7d824353f385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9e849d-c6c3-48a7-9690-7d824353f385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6785f28-db0c-43ec-a530-1d0564b0bccb', 'volume_name': 'volume-a6785f28-db0c-43ec-a530-1d0564b0bccb', 'volume_size': 1, 'snapshot_id': 'ec192b83-5c1c-406a-b3d4-48ddd816938f'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f01569c-fb29-49ed-ba52-a25ac9ef5284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f01569c-fb29-49ed-ba52-a25ac9ef5284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574fbd39-870f-42a5-8d05-e295332fcc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:28 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Volume a6785f28-db0c-43ec-a530-1d0564b0bccb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6785f28-db0c-43ec-a530-1d0564b0bccb', 'volume_size': 1, 'snapshot_id': 'ec192b83-5c1c-406a-b3d4-48ddd816938f'} Jul 05 02:52:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:29 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7" returned: 0 in 0.923s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:29 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 is being set with open permissions: ugo+rw Jul 05 02:52:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:29 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 Jul 05 02:52:29 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:30 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7" returned: 0 in 0.712s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.778s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.193s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Acquiring lock "cinder-quobyte-ec192b83-5c1c-406a-b3d4-48ddd816938f-a6785f28-db0c-43ec-a530-1d0564b0bccb" by "_create_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-ec192b83-5c1c-406a-b3d4-48ddd816938f-a6785f28-db0c-43ec-a530-1d0564b0bccb" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Creating volume a6785f28-db0c-43ec-a530-1d0564b0bccb from snapshot ec192b83-5c1c-406a-b3d4-48ddd816938f {{(pid=86671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Acquiring lock "cinder-quobyte-a6785f28-db0c-43ec-a530-1d0564b0bccb" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:30 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d712a1ce-07cf-453d-a17d-022f0de2cc94 tempest-VolumesSnapshotListTestJSON-1137804043 None] Create snapshot completed successfully Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-a6785f28-db0c-43ec-a530-1d0564b0bccb" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] snapshot: ec192b83-5c1c-406a-b3d4-48ddd816938f, volume: a6785f28-db0c-43ec-a530-1d0564b0bccb, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b03a565-c678-4f29-9d40-9c2adc6799b5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:30 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f Jul 05 02:52:30 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:31 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f" returned: 0 in 0.875s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c61167-067c-42c5-8581-fcc5151425be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:52:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:52:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:52:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cb52fb-7b03-4375-a11f-7aea8fcfc0f0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:31 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be Jul 05 02:52:31 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:32 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be" returned: 0 in 0.976s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:32 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:52:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:32 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb Jul 05 02:52:32 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:38 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb" returned: 0 in 6.443s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:38 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a1c2e1-11e6-4cf0-b85d-a990a57cb32c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:38 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be Jul 05 02:52:38 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:39 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be" returned: 0 in 1.251s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:39 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:52:39 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Converted 1024.00 MB image at 158.91 MB/s Jul 05 02:52:39 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb is being set with open permissions: ugo+rw Jul 05 02:52:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:39 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb Jul 05 02:52:39 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:40 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb" returned: 0 in 0.747s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-a6785f28-db0c-43ec-a530-1d0564b0bccb" released by "_copy_volume_from_snapshot" :: held 10.459s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-ec192b83-5c1c-406a-b3d4-48ddd816938f-a6785f28-db0c-43ec-a530-1d0564b0bccb" released by "_create_volume_from_snapshot" :: held 10.510s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.537s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.844s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] Creating offline snapshot 13ce65bf-25f3-4d1d-8798-6b5f0695301f of volume 4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574fbd39-870f-42a5-8d05-e295332fcc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6785f28-db0c-43ec-a530-1d0564b0bccb', 'volume_size': 1, 'snapshot_id': 'ec192b83-5c1c-406a-b3d4-48ddd816938f'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea87183-de5b-4446-a84f-2ec5e11bdbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce87ab81-2141-4799-9b80-31f153a1b827]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:40 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Volume volume-a6785f28-db0c-43ec-a530-1d0564b0bccb (a6785f28-db0c-43ec-a530-1d0564b0bccb): created successfully Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea87183-de5b-4446-a84f-2ec5e11bdbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Flow 'volume_create_manager' (58a86694-4c4d-4e0d-8ba3-24aad5d55138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:52:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-05174d16-edd5-4329-ad5e-287a85e36da6 tempest-TestStampPattern-1822824796 None] Created volume successfully. Jul 05 02:52:40 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 Jul 05 02:52:40 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:41 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7" returned: 0 in 0.913s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4520f036-057a-4028-8e80-2f59fb89110c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:52:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:41 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f 1G Jul 05 02:52:41 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:42 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f 1G" returned: 0 in 0.912s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:42 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f Jul 05 02:52:42 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f" returned: 0 in 0.698s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:43 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f is being set with open permissions: ugo+rw Jul 05 02:52:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:43 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:43 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f Jul 05 02:52:43 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:44 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f" returned: 0 in 0.771s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.458s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-7ff59473-b17f-4b7e-8524-e33a9a33c56f tempest-VolumesSnapshotListTestJSON-1137804043 None] Create snapshot completed successfully Jul 05 02:52:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-13ce65bf-25f3-4d1d-8798-6b5f0695301f-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-13ce65bf-25f3-4d1d-8798-6b5f0695301f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-quobyte-13ce65bf-25f3-4d1d-8798-6b5f0695301f" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-13ce65bf-25f3-4d1d-8798-6b5f0695301f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Deleting offline snapshot 13ce65bf-25f3-4d1d-8798-6b5f0695301f of volume 4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:52:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] snapshot_file for this snap is: volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:52:45 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a2d3b8-ba8c-4123-958e-0ffcde8e925d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:45 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f Jul 05 02:52:45 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:46 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f" returned: 0 in 0.943s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4520f036-057a-4028-8e80-2f59fb89110c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:52:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b8f63-0128-476c-9174-aaa453a12477]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:46 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 Jul 05 02:52:46 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:47 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7" returned: 0 in 0.898s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4520f036-057a-4028-8e80-2f59fb89110c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:52:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:47 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f Jul 05 02:52:47 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:48 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f" returned: 0 in 1.145s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:48 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f Jul 05 02:52:48 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:50 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.13ce65bf-25f3-4d1d-8798-6b5f0695301f" returned: 0 in 1.191s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-13ce65bf-25f3-4d1d-8798-6b5f0695301f" released by "_delete_snapshot" :: held 4.320s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" released by "delete_snapshot" :: held 4.350s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=47,cinder:UPDATE=51,cinder:INSERT=14,cinder:DELETE=6 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=52,cinder:SELECT=61,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Created reservations ['0988163c-d9c7-4dc7-81e1-fa5d611d852c', '562689a3-e6ff-4ad4-87b4-b0f09d620691', 'b6446bc7-e6f8-4496-be8e-61b250d32a76', '1b195020-cfe7-4267-bc34-dd3d34584b85'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:52:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Delete snapshot completed successfully. Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-41efd789-eefc-47a1-b09e-6dc2728c174a tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-13ce65bf-25f3-4d1d-8798-6b5f0695301f-delete_snapshot" released by "delete_snapshot" :: held 4.561s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Flow 'volume_create_manager' (e1bbeeff-ba19-4005-b4ac-609454c04649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a3a093-7c0c-4c93-82e3-c853f23f0c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a3a093-7c0c-4c93-82e3-c853f23f0c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-80466340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcd77a9-2d7e-4551-8842-b8e93a67d5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c97c6b821a144ea58456835bba0108e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:52:50Z,use_quota=True,user_id='99c1f7289ae84b1ea9a402c19a2b3833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26dc7c4-84b7-485c-9c53-4fd4ea2bc98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26dc7c4-84b7-485c-9c53-4fd4ea2bc98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f43b8b-bb4f-46e0-bc2d-bc389f64861e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f43b8b-bb4f-46e0-bc2d-bc389f64861e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bcd77a9-2d7e-4551-8842-b8e93a67d5e6', 'volume_name': 'volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebabcb9c-4fc7-43f3-886e-e53b02953f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebabcb9c-4fc7-43f3-886e-e53b02953f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f9f949-373b-4d06-9cf9-583237fb9494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:50 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Volume 4bcd77a9-2d7e-4551-8842-b8e93a67d5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6', 'volume_size': 1} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-80466340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcd77a9-2d7e-4551-8842-b8e93a67d5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c97c6b821a144ea58456835bba0108e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:52:50Z,use_quota=True,user_id='99c1f7289ae84b1ea9a402c19a2b3833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Creating volume 4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:52:50 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:52:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:50 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 1073741824 Jul 05 02:52:50 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-7fcbde32-3da3-49db-90d4-eb9a9ae42ad7-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-7fcbde32-3da3-49db-90d4-eb9a9ae42ad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Flow 'volume_create_manager' (805cc005-fdaa-4e29-8c9e-18ce4752d5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5004cba0-53e6-4cb4-98f7-02bf7877263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" acquired by "delete_snapshot" :: waited 0.112s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-quobyte-7fcbde32-3da3-49db-90d4-eb9a9ae42ad7" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5004cba0-53e6-4cb4-98f7-02bf7877263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-792658579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa558b4-3f6c-415d-8720-2ced9fab9cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c97c6b821a144ea58456835bba0108e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:52:51Z,use_quota=True,user_id='99c1f7289ae84b1ea9a402c19a2b3833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0850c926-3293-40c8-bdcf-e7544a99c3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0850c926-3293-40c8-bdcf-e7544a99c3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45219ec1-1ea1-46df-bed5-1b020d6814b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45219ec1-1ea1-46df-bed5-1b020d6814b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa558b4-3f6c-415d-8720-2ced9fab9cb8', 'volume_name': 'volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34be1ada-e74c-4a87-a34e-6f00c0ce3b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34be1ada-e74c-4a87-a34e-6f00c0ce3b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea442253-c5d2-419d-8335-59fc9b75707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:51 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Volume ffa558b4-3f6c-415d-8720-2ced9fab9cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8', 'volume_size': 1} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-7fcbde32-3da3-49db-90d4-eb9a9ae42ad7" acquired by "_delete_snapshot" :: waited 0.094s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Deleting offline snapshot 7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 of volume 4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] snapshot_file for this snap is: volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ff89bf-fc0d-41db-a364-a130d122d283]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:51 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 Jul 05 02:52:51 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:51 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 1073741824" returned: 0 in 1.267s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:52 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 Jul 05 02:52:52 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:52 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6" returned: 0 in 0.815s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.403s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-792658579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa558b4-3f6c-415d-8720-2ced9fab9cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c97c6b821a144ea58456835bba0108e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:52:51Z,use_quota=True,user_id='99c1f7289ae84b1ea9a402c19a2b3833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Creating volume ffa558b4-3f6c-415d-8720-2ced9fab9cb8 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:52:52 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:52 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 1073741824 Jul 05 02:52:52 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f9f949-373b-4d06-9cf9-583237fb9494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d196d155-7151-46e2-9c95-57870fe9b2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:52 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Volume volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 (4bcd77a9-2d7e-4551-8842-b8e93a67d5e6): created successfully Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d196d155-7151-46e2-9c95-57870fe9b2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Flow 'volume_create_manager' (e1bbeeff-ba19-4005-b4ac-609454c04649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:52:53 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ab917146-4c33-4c3f-abb7-408af24d75ce tempest-TestServerVolumeAttachmentScenario-1081992626 None] Created volume successfully. Jul 05 02:52:53 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7" returned: 0 in 1.589s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4520f036-057a-4028-8e80-2f59fb89110c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:52:53 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f5f496-1b16-4e0e-85dc-fa40944a343a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:53 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b Jul 05 02:52:53 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:54 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 1073741824" returned: 0 in 1.421s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:54 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 Jul 05 02:52:54 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:54 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b" returned: 0 in 1.309s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4520f036-057a-4028-8e80-2f59fb89110c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:52:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:54 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 Jul 05 02:52:54 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:55 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8" returned: 0 in 0.858s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:52:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.386s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:52:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea442253-c5d2-419d-8335-59fc9b75707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c4b24d-556d-4cc6-a533-6d3b8c26fb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:52:55 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Volume volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 (ffa558b4-3f6c-415d-8720-2ced9fab9cb8): created successfully Jul 05 02:52:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c4b24d-556d-4cc6-a533-6d3b8c26fb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:52:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Flow 'volume_create_manager' (805cc005-fdaa-4e29-8c9e-18ce4752d5db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:52:55 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7" returned: 0 in 0.839s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:55 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b47d132a-f017-4f1b-9a82-7b53cc520ee1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Created volume successfully. Jul 05 02:52:55 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7 Jul 05 02:52:55 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:56 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.7fcbde32-3da3-49db-90d4-eb9a9ae42ad7" returned: 0 in 0.821s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-7fcbde32-3da3-49db-90d4-eb9a9ae42ad7" released by "_delete_snapshot" :: held 4.711s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" released by "delete_snapshot" :: held 4.820s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Created reservations ['88c4e58b-5991-4267-a667-680a8fde9fab', '45b8fe7b-14a8-4084-b9be-15286c539290', 'fcabac78-9404-46f3-a853-b22136ce02e6', 'bc09aac1-d135-46b3-8d51-93f8608bba5a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:52:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Delete snapshot completed successfully. Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-277a90bb-5029-4617-afdc-d3cf8108ce32 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-7fcbde32-3da3-49db-90d4-eb9a9ae42ad7-delete_snapshot" released by "delete_snapshot" :: held 5.066s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-33bbe77f-de1a-4290-ac7d-a681d61fa91b-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-33bbe77f-de1a-4290-ac7d-a681d61fa91b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-quobyte-33bbe77f-de1a-4290-ac7d-a681d61fa91b" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-33bbe77f-de1a-4290-ac7d-a681d61fa91b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Deleting offline snapshot 33bbe77f-de1a-4290-ac7d-a681d61fa91b of volume 4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] snapshot_file for this snap is: volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca76966-914a-465b-a757-91bd725c1776]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:56 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b Jul 05 02:52:56 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:57 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b" returned: 0 in 0.814s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4520f036-057a-4028-8e80-2f59fb89110c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:52:57 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[88844c8a-36ee-410c-8c9e-9166dae7a6f8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:52:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:57 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c Jul 05 02:52:57 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:58 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c" returned: 0 in 0.813s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:58 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b Jul 05 02:52:58 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:59 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b" returned: 0 in 0.793s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:52:59 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b Jul 05 02:52:59 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:52:59 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 05 02:52:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c.33bbe77f-de1a-4290-ac7d-a681d61fa91b" returned: 0 in 0.640s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:52:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-33bbe77f-de1a-4290-ac7d-a681d61fa91b" released by "_delete_snapshot" :: held 3.156s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" released by "delete_snapshot" :: held 3.181s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:52:59 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Created reservations ['44ff8f6e-0dff-402f-8b99-3627388fc78a', 'ca20d8fa-9493-427e-b5ab-4cd2f85d03c8', '2f46f4e9-d099-47a8-bc38-c898f7bde538', 'd5b1d5c4-a7fb-4cc0-b2c5-60a8d658465b'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:52:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Delete snapshot completed successfully. Jul 05 02:52:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5ef6ca93-f02c-41f1-98d0-a4d88a926a65 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-33bbe77f-de1a-4290-ac7d-a681d61fa91b-delete_snapshot" released by "delete_snapshot" :: held 3.345s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:53:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-4520f036-057a-4028-8e80-2f59fb89110c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:53:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-4520f036-057a-4028-8e80-2f59fb89110c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:53:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:53:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:53:01 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[241fd88b-0b48-46c7-9038-347d28eb4187]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:01 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c Jul 05 02:53:01 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:01 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c" returned: 0 in 0.858s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:01 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c Jul 05 02:53:01 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:02 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4520f036-057a-4028-8e80-2f59fb89110c" returned: 0 in 0.650s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-quobyte-4520f036-057a-4028-8e80-2f59fb89110c" released by "delete_volume" :: held 1.572s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:53:02 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Created reservations ['0df7df9e-29ba-4d48-bffe-475d20a4f91b', 'b0c7a02f-6679-4883-a032-aab29722f7cb', '830d7068-5fcf-496f-bc42-769f7cf3379f', '298538c8-2f44-441c-ba3a-fe93fbb4bd90'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:53:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:53:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:53:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:53:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:53:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:53:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:02 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:53:02 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:03 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.678s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:03 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:53:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Deleted volume successfully. Jul 05 02:53:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-58640bae-5fef-40b8-9c81-57286ba7dcb0 tempest-VolumesSnapshotListTestJSON-1137804043 None] Lock "cinder-4520f036-057a-4028-8e80-2f59fb89110c-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:53:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:53:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:53:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:53:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:53:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:53:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:53:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:05 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:53:05 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:06 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.170s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:53:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:53:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:53:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:53:12 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=23,cinder:INSERT=10,cinder:UPDATE=36 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:53:13 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:INSERT=8,cinder:SELECT=23,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:53:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-f5c2a182-b875-4ca9-beb3-5bcafd7c5aec req-6002bd27-79da-41d8-9b56-f14a183cb253 tempest-TestStampPattern-1822824796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:53:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-f5c2a182-b875-4ca9-beb3-5bcafd7c5aec req-6002bd27-79da-41d8-9b56-f14a183cb253 tempest-TestStampPattern-1822824796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:53:18 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bedf1e-4388-46e3-8c02-30dacfb1b652]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-f5c2a182-b875-4ca9-beb3-5bcafd7c5aec req-6002bd27-79da-41d8-9b56-f14a183cb253 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:18 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb Jul 05 02:53:18 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:19 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-f5c2a182-b875-4ca9-beb3-5bcafd7c5aec req-6002bd27-79da-41d8-9b56-f14a183cb253 tempest-TestStampPattern-1822824796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb" returned: 0 in 0.826s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-f5c2a182-b875-4ca9-beb3-5bcafd7c5aec req-6002bd27-79da-41d8-9b56-f14a183cb253 tempest-TestStampPattern-1822824796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:53:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-f5c2a182-b875-4ca9-beb3-5bcafd7c5aec req-6002bd27-79da-41d8-9b56-f14a183cb253 tempest-TestStampPattern-1822824796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-a6785f28-db0c-43ec-a530-1d0564b0bccb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '326f20bb-504e-488c-a954-e7eacffe5bff', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:53:19 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-f5c2a182-b875-4ca9-beb3-5bcafd7c5aec req-6002bd27-79da-41d8-9b56-f14a183cb253 tempest-TestStampPattern-1822824796 None] attachment_update completed successfully. Jul 05 02:53:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-1567d6a3-8c92-4cbc-8490-f3bbcce7c0ec req-fa2da7df-acf2-4d4d-93af-928635cf5bfe tempest-TestStampPattern-1822824796 None] Terminate volume connection completed successfully. Jul 05 02:53:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-1567d6a3-8c92-4cbc-8490-f3bbcce7c0ec req-fa2da7df-acf2-4d4d-93af-928635cf5bfe tempest-TestStampPattern-1822824796 None] Deleting attachment 326f20bb-504e-488c-a954-e7eacffe5bff. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:53:29 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Flow 'volume_create_manager' (43281f31-78dc-4f3d-b92e-279c2759ff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a370638-ef4f-4c6a-86b7-914fa9e3f27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a370638-ef4f-4c6a-86b7-914fa9e3f27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-477631227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca9247e-9e7c-4b2c-9e48-f8282677f127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e32c95288c440d892a42ee31ed9621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:53:33Z,use_quota=True,user_id='184cce14eae544f3903e9c1725e72361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341a9b07-faa9-4aa9-a4a4-efc7ca4c4a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341a9b07-faa9-4aa9-a4a4-efc7ca4c4a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0871645f-a333-42d9-bf90-1d492c4fed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.image.glance [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Creating Keystone auth plugin from conf {{(pid=86671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0871645f-a333-42d9-bf90-1d492c4fed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bca9247e-9e7c-4b2c-9e48-f8282677f127', 'volume_name': 'volume-bca9247e-9e7c-4b2c-9e48-f8282677f127', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87db470-bfe6-4d3e-8140-ae328f4cbe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87db470-bfe6-4d3e-8140-ae328f4cbe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c986abe-1235-4da2-8dd6-a376a39bcf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:53:33 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Volume bca9247e-9e7c-4b2c-9e48-f8282677f127: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bca9247e-9e7c-4b2c-9e48-f8282677f127', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Trying to clone bca9247e-9e7c-4b2c-9e48-f8282677f127 from image c1baa924-f45f-4a01-ae62-ac21392667fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]). {{(pid=86671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 05 02:53:33 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 02:53:33 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Image download 20.69 MB at 20.69 MB/s Jul 05 02:53:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef961036-fa35-4d4c-9325-db6f0bdb8809]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:34 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD Jul 05 02:53:34 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-65641598-3dba-44d2-bfb4-5da6c690279b req-63f5565a-4ab4-4af2-bc38-1186efb1161d tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:53:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-65641598-3dba-44d2-bfb4-5da6c690279b req-63f5565a-4ab4-4af2-bc38-1186efb1161d tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:53:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[990dc31b-5f29-44fd-94d5-d2954939f7e8]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-65641598-3dba-44d2-bfb4-5da6c690279b req-63f5565a-4ab4-4af2-bc38-1186efb1161d tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:34 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 Jul 05 02:53:34 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:34 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:34 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Temporary image c1baa924-f45f-4a01-ae62-ac21392667fc is fetched for user 184cce14eae544f3903e9c1725e72361. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 02:53:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d36e67-e0c7-4fa6-bb64-7b579c324fb4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:34 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD Jul 05 02:53:34 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:35 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-65641598-3dba-44d2-bfb4-5da6c690279b req-63f5565a-4ab4-4af2-bc38-1186efb1161d tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6" returned: 0 in 0.804s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-65641598-3dba-44d2-bfb4-5da6c690279b req-63f5565a-4ab4-4af2-bc38-1186efb1161d tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.820s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-65641598-3dba-44d2-bfb4-5da6c690279b req-63f5565a-4ab4-4af2-bc38-1186efb1161d tempest-TestServerVolumeAttachmentScenario-1081992626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bee2dabc-753d-4c97-85f0-6d5470d7f9a0', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:53:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-65641598-3dba-44d2-bfb4-5da6c690279b req-63f5565a-4ab4-4af2-bc38-1186efb1161d tempest-TestServerVolumeAttachmentScenario-1081992626 None] attachment_update completed successfully. Jul 05 02:53:35 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-477631227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca9247e-9e7c-4b2c-9e48-f8282677f127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e32c95288c440d892a42ee31ed9621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:53:33Z,use_quota=True,user_id='184cce14eae544f3903e9c1725e72361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Creating volume bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:53:35 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:53:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:35 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 1073741824 Jul 05 02:53:35 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:36 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 1073741824" returned: 0 in 0.874s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:36 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:53:36 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:37 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 0 in 0.656s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Attempting download of c1baa924-f45f-4a01-ae62-ac21392667fc ((None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}])) to volume bca9247e-9e7c-4b2c-9e48-f8282677f127. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[60de6623-c457-4957-92ff-1dd5df6d685a]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_8_wo96kj {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:37 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_8_wo96kj Jul 05 02:53:37 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Acquiring lock "cinder-a6785f28-db0c-43ec-a530-1d0564b0bccb-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Lock "cinder-a6785f28-db0c-43ec-a530-1d0564b0bccb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Acquiring lock "cinder-quobyte-a6785f28-db0c-43ec-a530-1d0564b0bccb" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-a6785f28-db0c-43ec-a530-1d0564b0bccb" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d7215c-bdc5-4496-b747-0ae4ee0000b0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:37 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb Jul 05 02:53:37 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:38 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_8_wo96kj" returned: 0 in 0.774s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_8_wo96kj {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:38 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_8_wo96kj Jul 05 02:53:38 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:38 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb" returned: 0 in 0.791s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:38 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb Jul 05 02:53:38 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:38 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_8_wo96kj" returned: 1 in 0.754s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1baa924-f45f-4a01-ae62-ac21392667fc_8_wo96kj' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:53:38 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba3a984-7fd7-4abd-b133-6fa10f58605b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:38 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD Jul 05 02:53:38 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:39 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6785f28-db0c-43ec-a530-1d0564b0bccb" returned: 0 in 0.642s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-a6785f28-db0c-43ec-a530-1d0564b0bccb" released by "delete_volume" :: held 1.491s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Created reservations ['9dcfac85-ff28-4bcf-829c-06627f95e10c', '3e2be13d-49db-41cb-8740-317a2a8227dc', '414d8f3f-fa00-4fe4-9951-6660113ed130', '12387410-6cd6-4559-90bd-4589daf9d01a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:39 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:53:39 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:39 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] c1baa924-f45f-4a01-ae62-ac21392667fc was qcow2, converting to raw {{(pid=86671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 02:53:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:39 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:53:39 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:40 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.752s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:53:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Deleted volume successfully. Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2001b69b-7f54-4b92-8756-b61b09043a8d tempest-TestStampPattern-1822824796 None] Lock "cinder-a6785f28-db0c-43ec-a530-1d0564b0bccb-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Acquiring lock "cinder-ec192b83-5c1c-406a-b3d4-48ddd816938f-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Lock "cinder-ec192b83-5c1c-406a-b3d4-48ddd816938f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Acquiring lock "cinder-quobyte-c3c61167-067c-42c5-8581-fcc5151425be" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-c3c61167-067c-42c5-8581-fcc5151425be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Acquiring lock "cinder-quobyte-ec192b83-5c1c-406a-b3d4-48ddd816938f" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-ec192b83-5c1c-406a-b3d4-48ddd816938f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Deleting offline snapshot ec192b83-5c1c-406a-b3d4-48ddd816938f of volume c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] snapshot_file for this snap is: volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdadbe3-6b37-4afb-a584-7ebb6f666cec]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:40 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f Jul 05 02:53:40 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:41 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f" returned: 0 in 0.899s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c61167-067c-42c5-8581-fcc5151425be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:53:41 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac344d23-967e-421f-abad-fe5442d96dc5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:41 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be Jul 05 02:53:41 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:41 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 0 in 2.064s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:41 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1baa924-f45f-4a01-ae62-ac21392667fc_d2x_362qdevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:53:41 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Converted 112.00 MB image at 54.23 MB/s Jul 05 02:53:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:41 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 1G Jul 05 02:53:41 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:42 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be" returned: 0 in 0.826s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:42 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f Jul 05 02:53:42 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:42 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 1G" returned: 0 in 0.699s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:42 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efd9f78-026a-4e89-820f-e6269ecaad7f]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:42 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:53:42 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:42 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f" returned: 0 in 0.711s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:42 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f Jul 05 02:53:42 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:43 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 0 in 0.781s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:43 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:53:43 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:43 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be.ec192b83-5c1c-406a-b3d4-48ddd816938f" returned: 0 in 0.671s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-ec192b83-5c1c-406a-b3d4-48ddd816938f" released by "_delete_snapshot" :: held 3.239s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:53:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-c3c61167-067c-42c5-8581-fcc5151425be" released by "delete_snapshot" :: held 3.264s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:53:43 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Created reservations ['f596fbce-cc04-454f-9a3b-80d4e98f4547', 'b42031f8-cbb2-4717-9798-933f08945cd2', 'b791683f-5e07-432a-a795-42e1aebb6689', 'e0ebc92d-b3c4-456a-9309-077983773267'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:53:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Delete snapshot completed successfully. Jul 05 02:53:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a622bf7f-e198-4455-83d7-00458bb2b421 tempest-TestStampPattern-1822824796 None] Lock "cinder-ec192b83-5c1c-406a-b3d4-48ddd816938f-delete_snapshot" released by "delete_snapshot" :: held 3.408s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:53:44 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 1 in 0.791s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Downloaded image c1baa924-f45f-4a01-ae62-ac21392667fc ((None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}])) to volume bca9247e-9e7c-4b2c-9e48-f8282677f127 successfully. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Temporary image c1baa924-f45f-4a01-ae62-ac21392667fc for user 184cce14eae544f3903e9c1725e72361 is deleted. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Marking volume bca9247e-9e7c-4b2c-9e48-f8282677f127 as bootable. {{(pid=86671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Copying metadata from image c1baa924-f45f-4a01-ae62-ac21392667fc to bca9247e-9e7c-4b2c-9e48-f8282677f127. {{(pid=86671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Creating volume glance metadata for volume bca9247e-9e7c-4b2c-9e48-f8282677f127 backed by image c1baa924-f45f-4a01-ae62-ac21392667fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c986abe-1235-4da2-8dd6-a376a39bcf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca9247e-9e7c-4b2c-9e48-f8282677f127', 'volume_size': 1, 'image_id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1baa924-f45f-4a01-ae62-ac21392667fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '378d55286f0f4eba83ee61ecc520b467', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1baa924-f45f-4a01-ae62-ac21392667fc', 'created_at': datetime.datetime(2026, 7, 5, 0, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1baa924-f45f-4a01-ae62-ac21392667fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251a595e-380c-4b8b-8128-615970aad2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:53:44 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Volume volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 (bca9247e-9e7c-4b2c-9e48-f8282677f127): created successfully Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251a595e-380c-4b8b-8128-615970aad2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Flow 'volume_create_manager' (43281f31-78dc-4f3d-b92e-279c2759ff7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:53:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4f730cc9-4359-4405-97fd-673ddc966dc4 tempest-TestShelveInstance-543445681 None] Created volume successfully. Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-24df23e2-9e1a-4f50-a99f-f93452d7f7a1 req-75cd3ef4-8dc6-4d11-8d0c-8207c9057c1e tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-24df23e2-9e1a-4f50-a99f-f93452d7f7a1 req-75cd3ef4-8dc6-4d11-8d0c-8207c9057c1e tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfd1553-771f-4055-9bfa-2d4de41e2505]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-24df23e2-9e1a-4f50-a99f-f93452d7f7a1 req-75cd3ef4-8dc6-4d11-8d0c-8207c9057c1e tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:44 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 Jul 05 02:53:44 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:45 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-24df23e2-9e1a-4f50-a99f-f93452d7f7a1 req-75cd3ef4-8dc6-4d11-8d0c-8207c9057c1e tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8" returned: 0 in 0.869s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-24df23e2-9e1a-4f50-a99f-f93452d7f7a1 req-75cd3ef4-8dc6-4d11-8d0c-8207c9057c1e tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:53:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-24df23e2-9e1a-4f50-a99f-f93452d7f7a1 req-75cd3ef4-8dc6-4d11-8d0c-8207c9057c1e tempest-TestServerVolumeAttachmentScenario-1081992626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e58805db-545f-44d7-8cea-9226da2a780a', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:53:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-24df23e2-9e1a-4f50-a99f-f93452d7f7a1 req-75cd3ef4-8dc6-4d11-8d0c-8207c9057c1e tempest-TestServerVolumeAttachmentScenario-1081992626 None] attachment_update completed successfully. Jul 05 02:53:51 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-d4013829-4224-47fa-a0ae-21bcf44d04e6 req-1b784088-c7f8-40e7-bb92-d0d6121a4116 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Terminate volume connection completed successfully. Jul 05 02:53:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-d4013829-4224-47fa-a0ae-21bcf44d04e6 req-1b784088-c7f8-40e7-bb92-d0d6121a4116 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Deleting attachment e58805db-545f-44d7-8cea-9226da2a780a. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:53:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c94c7fca-9865-45ce-a4f6-15a89076db2e req-d7061cd1-95ab-46b2-840a-2ea9fbac4176 tempest-TestShelveInstance-543445681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:53:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c94c7fca-9865-45ce-a4f6-15a89076db2e req-d7061cd1-95ab-46b2-840a-2ea9fbac4176 tempest-TestShelveInstance-543445681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:53:52 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f0a222-bd3f-419e-8482-2fb7566cb49f]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c94c7fca-9865-45ce-a4f6-15a89076db2e req-d7061cd1-95ab-46b2-840a-2ea9fbac4176 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:52 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:53:52 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Acquiring lock "cinder-c3c61167-067c-42c5-8581-fcc5151425be-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:53:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Lock "cinder-c3c61167-067c-42c5-8581-fcc5151425be-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:53:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Acquiring lock "cinder-quobyte-c3c61167-067c-42c5-8581-fcc5151425be" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:53:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-c3c61167-067c-42c5-8581-fcc5151425be" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:53:53 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cfa3e6-c4d4-4a45-be43-130fddd0943c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:53:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:53 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be Jul 05 02:53:53 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:53 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c94c7fca-9865-45ce-a4f6-15a89076db2e req-d7061cd1-95ab-46b2-840a-2ea9fbac4176 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 0 in 0.855s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c94c7fca-9865-45ce-a4f6-15a89076db2e req-d7061cd1-95ab-46b2-840a-2ea9fbac4176 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:53 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:53:53 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:53 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be" returned: 0 in 0.895s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:53 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be Jul 05 02:53:53 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:54 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c94c7fca-9865-45ce-a4f6-15a89076db2e req-d7061cd1-95ab-46b2-840a-2ea9fbac4176 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 1 in 0.848s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c94c7fca-9865-45ce-a4f6-15a89076db2e req-d7061cd1-95ab-46b2-840a-2ea9fbac4176 tempest-TestShelveInstance-543445681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c94c7fca-9865-45ce-a4f6-15a89076db2e req-d7061cd1-95ab-46b2-840a-2ea9fbac4176 tempest-TestShelveInstance-543445681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.740s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-c94c7fca-9865-45ce-a4f6-15a89076db2e req-d7061cd1-95ab-46b2-840a-2ea9fbac4176 tempest-TestShelveInstance-543445681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-bca9247e-9e7c-4b2c-9e48-f8282677f127', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6bb4371-a8b5-4d75-8a91-b02466df716f', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:53:54 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-c94c7fca-9865-45ce-a4f6-15a89076db2e req-d7061cd1-95ab-46b2-840a-2ea9fbac4176 tempest-TestShelveInstance-543445681 None] attachment_update completed successfully. Jul 05 02:53:54 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c3c61167-067c-42c5-8581-fcc5151425be" returned: 0 in 0.666s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Lock "cinder-quobyte-c3c61167-067c-42c5-8581-fcc5151425be" released by "delete_volume" :: held 1.626s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Created reservations ['834d0dac-7a66-44ea-94ea-ca791fdb1e75', '050e4a5b-b09f-4355-98c4-6f01d406e1f7', '6d3ea1e5-f919-4c63-97d3-6485c582af5e', 'c90d7584-7c0a-48be-865b-c9fbd3e6b273'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:53:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:53:54 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:53:54 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:53:55 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-f796b3bf-d367-4434-a5e5-66f6f79a8c6f req-9722e5ab-c7dd-4d27-af64-49421a0ca5a1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Terminate volume connection completed successfully. Jul 05 02:53:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-f796b3bf-d367-4434-a5e5-66f6f79a8c6f req-9722e5ab-c7dd-4d27-af64-49421a0ca5a1 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Deleting attachment bee2dabc-753d-4c97-85f0-6d5470d7f9a0. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:53:55 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jul 05 02:53:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.760s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:53:55 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:53:55 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Deleted volume successfully. Jul 05 02:53:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6bc373df-ed18-4fd2-9ee9-f57dc693af07 tempest-TestStampPattern-1822824796 None] Lock "cinder-c3c61167-067c-42c5-8581-fcc5151425be-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:05 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=43,cinder:UPDATE=31,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:54:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:54:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:05 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:54:05 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:05 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=50,cinder:UPDATE=31,cinder:INSERT=15,cinder:DELETE=2 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:54:06 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.147s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:54:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:54:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:54:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:54:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "cinder-ffa558b4-3f6c-415d-8720-2ced9fab9cb8-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "cinder-ffa558b4-3f6c-415d-8720-2ced9fab9cb8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "cinder-quobyte-ffa558b4-3f6c-415d-8720-2ced9fab9cb8" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "cinder-quobyte-ffa558b4-3f6c-415d-8720-2ced9fab9cb8" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:07 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead1abe2-e597-4220-b913-4bba965718cb]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:07 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 Jul 05 02:54:07 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:08 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8" returned: 0 in 1.074s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:08 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8 Jul 05 02:54:08 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:08 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ffa558b4-3f6c-415d-8720-2ced9fab9cb8" returned: 0 in 0.743s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "cinder-quobyte-ffa558b4-3f6c-415d-8720-2ced9fab9cb8" released by "delete_volume" :: held 1.867s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Created reservations ['32d54715-d8b2-485e-82e6-06cf81cce1ba', '0bc046ab-ca4c-4fb9-8206-474811efe6c9', 'f73c251a-9d3e-49c5-a8c8-a2342a38cf7e', '616ea3dd-7986-420f-9638-502b4be3c54c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:09 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:54:09 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "cinder-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "cinder-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "cinder-quobyte-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "cinder-quobyte-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6" acquired by "delete_volume" :: waited 0.029s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92637ba-9179-4d23-a7ad-8805482a121a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:09 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 Jul 05 02:54:09 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:10 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.892s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:10 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:54:10 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Deleted volume successfully. Jul 05 02:54:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-02c7ccae-00d9-4444-86ed-4ebe6ab36cd8 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "cinder-ffa558b4-3f6c-415d-8720-2ced9fab9cb8-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:10 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6" returned: 0 in 0.883s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:10 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6 Jul 05 02:54:10 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:11 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6" returned: 0 in 0.678s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "cinder-quobyte-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6" released by "delete_volume" :: held 1.619s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Created reservations ['ff46395a-09cc-435a-8711-4f15b0376e50', 'bdc0e112-2c7e-403b-9195-82b64f4b4621', '38c79658-d4cf-48bb-98df-c5681cc85cb7', '3397aafb-724e-4d38-912b-65f9702bcf67'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:11 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:54:11 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:11 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.718s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:11 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:54:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Deleted volume successfully. Jul 05 02:54:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-714cffce-5374-43dd-8aef-717e23fd2d49 tempest-TestServerVolumeAttachmentScenario-1081992626 None] Lock "cinder-4bcd77a9-2d7e-4551-8842-b8e93a67d5e6-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:13 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Flow 'volume_create_manager' (27720629-033f-449c-a939-29ecc516456e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38106951-3d37-48f0-b7f0-14230e58e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38106951-3d37-48f0-b7f0-14230e58e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb7f084-a375-47e0-a58c-bb0b6ba8dc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd5c95b66b94a1c9f22c5164db5ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:14Z,use_quota=True,user_id='948f466a6ce147ea89890f120a17eae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e08e57be-64d2-41ae-b417-ff7755092de6),volume_type_id=e08e57be-64d2-41ae-b417-ff7755092de6)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d08d0f-2171-40c4-b81d-d4784bacecf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d08d0f-2171-40c4-b81d-d4784bacecf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8223398e-09ce-4048-839c-88e151217ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:14 devstack cinder-volume[86671]: DEBUG cinder.image.glance [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Creating Keystone auth plugin from conf {{(pid=86671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 02:54:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8223398e-09ce-4048-839c-88e151217ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'beb7f084-a375-47e0-a58c-bb0b6ba8dc50', 'volume_name': 'volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50', 'volume_size': 1, 'image_id': '312b0aca-5c5f-4a70-af8e-e1527991668f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/312b0aca-5c5f-4a70-af8e-e1527991668f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fb6e20941d7bf8565b8c03765870a51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7bd5c95b66b94a1c9f22c5164db5ab51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7fbb5d9e47170485312333db4dd951d034c5c604450159b6b993ffad6cb8f665145db4fa010f045c84fff199a1e61660aad5dc4ed14632c1cdbe7aec980c56a', 'id': '312b0aca-5c5f-4a70-af8e-e1527991668f', 'created_at': datetime.datetime(2026, 7, 5, 0, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/312b0aca-5c5f-4a70-af8e-e1527991668f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f521165-4e08-4058-a555-be75235eece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f521165-4e08-4058-a555-be75235eece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea328a6-bb15-4ebd-ba65-64ce83b459b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:14 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Volume beb7f084-a375-47e0-a58c-bb0b6ba8dc50: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50', 'volume_size': 1, 'image_id': '312b0aca-5c5f-4a70-af8e-e1527991668f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/312b0aca-5c5f-4a70-af8e-e1527991668f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fb6e20941d7bf8565b8c03765870a51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7bd5c95b66b94a1c9f22c5164db5ab51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7fbb5d9e47170485312333db4dd951d034c5c604450159b6b993ffad6cb8f665145db4fa010f045c84fff199a1e61660aad5dc4ed14632c1cdbe7aec980c56a', 'id': '312b0aca-5c5f-4a70-af8e-e1527991668f', 'created_at': datetime.datetime(2026, 7, 5, 0, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/312b0aca-5c5f-4a70-af8e-e1527991668f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 05 02:54:14 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Trying to clone beb7f084-a375-47e0-a58c-bb0b6ba8dc50 from image 312b0aca-5c5f-4a70-af8e-e1527991668f at location (None, [{'url': 'file:///opt/stack/data/glance/images/312b0aca-5c5f-4a70-af8e-e1527991668f', 'metadata': {}}]). {{(pid=86671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 05 02:54:14 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 02:54:14 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Image download 0.00 MB at 0.00 MB/s Jul 05 02:54:14 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4527c53e-7956-4214-bdcc-a93160226eaa]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:14 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD Jul 05 02:54:14 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:15 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD" returned: 0 in 0.876s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:15 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD Jul 05 02:54:15 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:16 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD" returned: 1 in 0.849s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:16 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Temporary image 312b0aca-5c5f-4a70-af8e-e1527991668f is fetched for user 948f466a6ce147ea89890f120a17eae5. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 02:54:16 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61ea9e0-768a-4810-a767-59507d39e9d9]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:16 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD Jul 05 02:54:16 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:17 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:17 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD Jul 05 02:54:17 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:18 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD" returned: 1 in 0.753s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb7f084-a375-47e0-a58c-bb0b6ba8dc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd5c95b66b94a1c9f22c5164db5ab51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:14Z,use_quota=True,user_id='948f466a6ce147ea89890f120a17eae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e08e57be-64d2-41ae-b417-ff7755092de6),volume_type_id=e08e57be-64d2-41ae-b417-ff7755092de6)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Creating volume beb7f084-a375-47e0-a58c-bb0b6ba8dc50 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:18 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:18 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 1073741824 Jul 05 02:54:18 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:18 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 1073741824" returned: 0 in 0.932s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:19 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 Jul 05 02:54:19 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:19 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50" returned: 0 in 0.696s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:19 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Attempting download of 312b0aca-5c5f-4a70-af8e-e1527991668f ((None, [{'url': 'file:///opt/stack/data/glance/images/312b0aca-5c5f-4a70-af8e-e1527991668f', 'metadata': {}}])) to volume beb7f084-a375-47e0-a58c-bb0b6ba8dc50. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 02:54:19 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[50934538-731d-48ac-9027-26b493d8a9c7]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_312b0aca-5c5f-4a70-af8e-e1527991668f_p0y5wrwf {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:19 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_312b0aca-5c5f-4a70-af8e-e1527991668f_p0y5wrwf Jul 05 02:54:19 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:20 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_312b0aca-5c5f-4a70-af8e-e1527991668f_p0y5wrwf" returned: 0 in 0.755s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_312b0aca-5c5f-4a70-af8e-e1527991668f_p0y5wrwf {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:20 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_312b0aca-5c5f-4a70-af8e-e1527991668f_p0y5wrwf Jul 05 02:54:20 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:21 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_312b0aca-5c5f-4a70-af8e-e1527991668f_p0y5wrwf" returned: 1 in 0.751s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_312b0aca-5c5f-4a70-af8e-e1527991668f_p0y5wrwf' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:21 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaa5f3d-9c2d-4eef-a2a1-d84d984f1a95]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:21 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD Jul 05 02:54:21 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:22 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:22 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD Jul 05 02:54:22 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Flow 'volume_create_manager' (6137ac6b-fbda-4f69-b5fb-aec99bd2d91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fae2a49-fa3f-4d9f-bfe9-e3424ce8a6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fae2a49-fa3f-4d9f-bfe9-e3424ce8a6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1449050112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2508586b-6bd3-46c5-98bf-95e75ee200f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26ea5fb68814b53906f76de4b580530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:22Z,use_quota=True,user_id='5c10a5f383e84539809261575fabb2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f862e9-906f-47f0-b8f4-b178e8d312df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f862e9-906f-47f0-b8f4-b178e8d312df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c30ccb-9e76-4166-a221-f9171201d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c30ccb-9e76-4166-a221-f9171201d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2508586b-6bd3-46c5-98bf-95e75ee200f7', 'volume_name': 'volume-2508586b-6bd3-46c5-98bf-95e75ee200f7', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d659d728-a26c-4863-8bce-45cc14fb008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d659d728-a26c-4863-8bce-45cc14fb008f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5c5a37-de38-46a0-8af3-e36de7c9a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:22 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Volume 2508586b-6bd3-46c5-98bf-95e75ee200f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2508586b-6bd3-46c5-98bf-95e75ee200f7', 'volume_size': 1} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1449050112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2508586b-6bd3-46c5-98bf-95e75ee200f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26ea5fb68814b53906f76de4b580530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:22Z,use_quota=True,user_id='5c10a5f383e84539809261575fabb2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Creating volume 2508586b-6bd3-46c5-98bf-95e75ee200f7 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:22 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:22 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7 1073741824 Jul 05 02:54:22 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:22 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD" returned: 1 in 0.796s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] 312b0aca-5c5f-4a70-af8e-e1527991668f was raw, converting to raw {{(pid=86671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:22 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 Jul 05 02:54:22 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:22 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Flow 'volume_create_manager' (88afba02-b418-4494-aa30-783fa227e000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9caa8768-6e57-40c6-ac4d-5dbbf7642b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9caa8768-6e57-40c6-ac4d-5dbbf7642b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-139786941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e599b79-5d2d-4abd-9073-47a049c9c3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26ea5fb68814b53906f76de4b580530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:23Z,use_quota=True,user_id='5c10a5f383e84539809261575fabb2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db4297e-6831-45ba-a614-13da4f2b9783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db4297e-6831-45ba-a614-13da4f2b9783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8105a6-d6dc-4a20-94ec-d4e022d3a37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8105a6-d6dc-4a20-94ec-d4e022d3a37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e599b79-5d2d-4abd-9073-47a049c9c3b1', 'volume_name': 'volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7211cc3-928a-46d8-9b8e-477f6ecd91f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7211cc3-928a-46d8-9b8e-477f6ecd91f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a2a13f-29e3-41f7-a6d1-a0d30ff2cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:23 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Volume 4e599b79-5d2d-4abd-9073-47a049c9c3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1', 'volume_size': 1} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Flow 'volume_create_manager' (e695a3ac-eed4-4965-ada1-2a4459d736bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efe0dea-22be-4fa3-a979-90c2f8470865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8efe0dea-22be-4fa3-a979-90c2f8470865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392395974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769c9982-8078-46c1-9474-2379c560f06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26ea5fb68814b53906f76de4b580530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:23Z,use_quota=True,user_id='5c10a5f383e84539809261575fabb2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0b41ef-92fe-42f4-a48e-8a757487100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0b41ef-92fe-42f4-a48e-8a757487100e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfedcebe-8027-4989-b709-57f95fa227c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfedcebe-8027-4989-b709-57f95fa227c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769c9982-8078-46c1-9474-2379c560f06e', 'volume_name': 'volume-769c9982-8078-46c1-9474-2379c560f06e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3695556c-7b21-4645-a1e2-6ba14d8c051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3695556c-7b21-4645-a1e2-6ba14d8c051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c200cb-12cb-4bf3-9d9c-2cdb838e5e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:23 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Volume 769c9982-8078-46c1-9474-2379c560f06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769c9982-8078-46c1-9474-2379c560f06e', 'volume_size': 1} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:23 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7 1073741824" returned: 0 in 1.242s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Flow 'volume_create_manager' (b6fb3adc-e8a4-42db-a19f-fd64cba1f879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6710499-8ae2-4edf-a44a-1451d694f5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6710499-8ae2-4edf-a44a-1451d694f5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1947319352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76920cf-f27e-4532-86d2-f1a0b393405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26ea5fb68814b53906f76de4b580530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:24Z,use_quota=True,user_id='5c10a5f383e84539809261575fabb2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0705ed-3cf0-4605-98cd-1a56e2b7372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0705ed-3cf0-4605-98cd-1a56e2b7372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc53f07-34be-4440-a3fa-81d341e7a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc53f07-34be-4440-a3fa-81d341e7a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a76920cf-f27e-4532-86d2-f1a0b393405c', 'volume_name': 'volume-a76920cf-f27e-4532-86d2-f1a0b393405c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a5363d-b1b0-4de5-9f3a-66933793798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a5363d-b1b0-4de5-9f3a-66933793798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768c3875-a489-4d16-afe4-3b1a16a6453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Volume a76920cf-f27e-4532-86d2-f1a0b393405c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a76920cf-f27e-4532-86d2-f1a0b393405c', 'volume_size': 1} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:24 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7 Jul 05 02:54:24 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:24 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50" returned: 0 in 1.227s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_312b0aca-5c5f-4a70-af8e-e1527991668f_9_d1at8pdevstack@QuobyteHD, size 0.00 MB, duration 1.23 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:54:24 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:24 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 1G Jul 05 02:54:24 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Flow 'volume_create_manager' (8718f564-508d-439c-81cd-4a93f3c0463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba71abd5-f2b5-49bf-8185-9be3f55484a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba71abd5-f2b5-49bf-8185-9be3f55484a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1597080147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2bf778-244c-40ee-8efc-64c0af2e409c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26ea5fb68814b53906f76de4b580530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:24Z,use_quota=True,user_id='5c10a5f383e84539809261575fabb2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78efa50-9375-48f9-b07d-024a4601671c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78efa50-9375-48f9-b07d-024a4601671c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fe2440-d7b5-41f4-9d71-00303aeb8252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fe2440-d7b5-41f4-9d71-00303aeb8252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2bf778-244c-40ee-8efc-64c0af2e409c', 'volume_name': 'volume-1c2bf778-244c-40ee-8efc-64c0af2e409c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f64548-f510-47cb-a43b-a659721ec3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f64548-f510-47cb-a43b-a659721ec3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0b835c-a5fb-4779-bf87-a4de91a9ca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Volume 1c2bf778-244c-40ee-8efc-64c0af2e409c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2bf778-244c-40ee-8efc-64c0af2e409c', 'volume_size': 1} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:24 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7" returned: 0 in 0.794s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] <== create_volume: return (2211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-139786941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e599b79-5d2d-4abd-9073-47a049c9c3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26ea5fb68814b53906f76de4b580530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:23Z,use_quota=True,user_id='5c10a5f383e84539809261575fabb2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Creating volume 4e599b79-5d2d-4abd-9073-47a049c9c3b1 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:24 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5c5a37-de38-46a0-8af3-e36de7c9a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2508586b-6bd3-46c5-98bf-95e75ee200f7', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:24 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1 1073741824 Jul 05 02:54:24 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b6ba42-93a3-4278-8abb-921323b02328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:24 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Volume volume-2508586b-6bd3-46c5-98bf-95e75ee200f7 (2508586b-6bd3-46c5-98bf-95e75ee200f7): created successfully Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b6ba42-93a3-4278-8abb-921323b02328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Flow 'volume_create_manager' (6137ac6b-fbda-4f69-b5fb-aec99bd2d91e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:24 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 1G" returned: 0 in 0.838s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4ad0e0d5-f502-4549-8d0b-3cce3273680a tempest-CreateVolumesFromImageTest-738475168 None] Created volume successfully. Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[273cd6ed-97e2-4b27-a2e9-ee00399055db]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:25 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 Jul 05 02:54:25 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:25 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50" returned: 0 in 0.807s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:25 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1 1073741824" returned: 0 in 0.943s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:25 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1 Jul 05 02:54:25 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:25 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 Jul 05 02:54:25 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:26 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1" returned: 0 in 0.764s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.090s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392395974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769c9982-8078-46c1-9474-2379c560f06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26ea5fb68814b53906f76de4b580530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:23Z,use_quota=True,user_id='5c10a5f383e84539809261575fabb2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Creating volume 769c9982-8078-46c1-9474-2379c560f06e {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:26 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:26 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50" returned: 1 in 0.849s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Downloaded image 312b0aca-5c5f-4a70-af8e-e1527991668f ((None, [{'url': 'file:///opt/stack/data/glance/images/312b0aca-5c5f-4a70-af8e-e1527991668f', 'metadata': {}}])) to volume beb7f084-a375-47e0-a58c-bb0b6ba8dc50 successfully. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Temporary image 312b0aca-5c5f-4a70-af8e-e1527991668f for user 948f466a6ce147ea89890f120a17eae5 is deleted. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Marking volume beb7f084-a375-47e0-a58c-bb0b6ba8dc50 as bootable. {{(pid=86671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 02:54:26 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e 1073741824 Jul 05 02:54:26 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a2a13f-29e3-41f7-a6d1-a0d30ff2cb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58736ae5-2e86-4584-b44a-4cd429f69ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Copying metadata from image 312b0aca-5c5f-4a70-af8e-e1527991668f to beb7f084-a375-47e0-a58c-bb0b6ba8dc50. {{(pid=86671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Creating volume glance metadata for volume beb7f084-a375-47e0-a58c-bb0b6ba8dc50 backed by image 312b0aca-5c5f-4a70-af8e-e1527991668f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '312b0aca-5c5f-4a70-af8e-e1527991668f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6fb6e20941d7bf8565b8c03765870a51', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 02:54:26 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Volume volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1 (4e599b79-5d2d-4abd-9073-47a049c9c3b1): created successfully Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58736ae5-2e86-4584-b44a-4cd429f69ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Flow 'volume_create_manager' (88afba02-b418-4494-aa30-783fa227e000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d5f8f55b-e31d-47da-9da5-358d778e0691 tempest-CreateVolumesFromImageTest-738475168 None] Created volume successfully. Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea328a6-bb15-4ebd-ba65-64ce83b459b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50', 'volume_size': 1, 'image_id': '312b0aca-5c5f-4a70-af8e-e1527991668f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/312b0aca-5c5f-4a70-af8e-e1527991668f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fb6e20941d7bf8565b8c03765870a51', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7bd5c95b66b94a1c9f22c5164db5ab51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7fbb5d9e47170485312333db4dd951d034c5c604450159b6b993ffad6cb8f665145db4fa010f045c84fff199a1e61660aad5dc4ed14632c1cdbe7aec980c56a', 'id': '312b0aca-5c5f-4a70-af8e-e1527991668f', 'created_at': datetime.datetime(2026, 7, 5, 0, 54, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 54, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/312b0aca-5c5f-4a70-af8e-e1527991668f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6485701-a808-48ef-8f66-332e6cdb08d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:26 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Volume volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 (beb7f084-a375-47e0-a58c-bb0b6ba8dc50): created successfully Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6485701-a808-48ef-8f66-332e6cdb08d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Flow 'volume_create_manager' (27720629-033f-449c-a939-29ecc516456e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-65a3fa5d-bf41-4ca1-a555-d189749bac96 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Created volume successfully. Jul 05 02:54:27 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e 1073741824" returned: 0 in 0.888s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:27 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e Jul 05 02:54:27 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Acquiring lock "cinder-beb7f084-a375-47e0-a58c-bb0b6ba8dc50-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Lock "cinder-beb7f084-a375-47e0-a58c-bb0b6ba8dc50-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Acquiring lock "cinder-quobyte-beb7f084-a375-47e0-a58c-bb0b6ba8dc50" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Lock "cinder-quobyte-beb7f084-a375-47e0-a58c-bb0b6ba8dc50" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c67e1d-c9de-4471-9bbb-f017127e208b]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:28 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 Jul 05 02:54:28 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:28 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e" returned: 0 in 0.664s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.162s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1947319352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76920cf-f27e-4532-86d2-f1a0b393405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26ea5fb68814b53906f76de4b580530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:24Z,use_quota=True,user_id='5c10a5f383e84539809261575fabb2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Creating volume a76920cf-f27e-4532-86d2-f1a0b393405c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:28 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c200cb-12cb-4bf3-9d9c-2cdb838e5e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769c9982-8078-46c1-9474-2379c560f06e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541ac33d-5843-4b21-80ff-f56bba85a6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:28 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c 1073741824 Jul 05 02:54:28 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:28 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Volume volume-769c9982-8078-46c1-9474-2379c560f06e (769c9982-8078-46c1-9474-2379c560f06e): created successfully Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541ac33d-5843-4b21-80ff-f56bba85a6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Flow 'volume_create_manager' (e695a3ac-eed4-4965-ada1-2a4459d736bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:28 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-39afb813-92c5-45cf-ab5a-c4e2deee0cfb tempest-CreateVolumesFromImageTest-738475168 None] Created volume successfully. Jul 05 02:54:28 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50" returned: 0 in 0.808s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:28 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 Jul 05 02:54:28 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:29 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c 1073741824" returned: 0 in 0.866s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:29 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c Jul 05 02:54:29 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:29 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50" returned: 1 in 0.771s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:29 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50 Jul 05 02:54:29 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:29 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c" returned: 0 in 0.650s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.273s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1597080147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2bf778-244c-40ee-8efc-64c0af2e409c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26ea5fb68814b53906f76de4b580530',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:24Z,use_quota=True,user_id='5c10a5f383e84539809261575fabb2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Creating volume 1c2bf778-244c-40ee-8efc-64c0af2e409c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:29 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:29 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c 1073741824 Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768c3875-a489-4d16-afe4-3b1a16a6453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76920cf-f27e-4532-86d2-f1a0b393405c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:29 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ac636f-615e-4a88-be5b-dd13630fac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:29 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Volume volume-a76920cf-f27e-4532-86d2-f1a0b393405c (a76920cf-f27e-4532-86d2-f1a0b393405c): created successfully Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ac636f-615e-4a88-be5b-dd13630fac05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Flow 'volume_create_manager' (b6fb3adc-e8a4-42db-a19f-fd64cba1f879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-099bce65-be30-4ca2-b3f6-993c41371452 tempest-CreateVolumesFromImageTest-738475168 None] Created volume successfully. Jul 05 02:54:30 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-beb7f084-a375-47e0-a58c-bb0b6ba8dc50" returned: 0 in 0.694s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Lock "cinder-quobyte-beb7f084-a375-47e0-a58c-bb0b6ba8dc50" released by "delete_volume" :: held 2.340s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:30 devstack cinder-volume[86671]: WARNING cinder.quota [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:54:30 devstack cinder-volume[86671]: WARNING cinder.quota [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Created reservations ['e9ec93d3-17dc-47e5-9c32-75a328fbcc97', '6187300f-14f6-45fc-af13-c316ce2aef6d', 'e6e281bd-732c-4966-af44-410a56d54771', '4784ee88-efe8-4735-b34c-a11f3d173c3e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:30 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:54:30 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:30 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c 1073741824" returned: 0 in 0.880s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:30 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c Jul 05 02:54:30 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:31 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.704s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:31 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:54:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Deleted volume successfully. Jul 05 02:54:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-94d4bfb9-433c-426c-8161-c766d6e18c99 tempest-VolumeAndVolumeTypeFromImageTest-147417265 None] Lock "cinder-beb7f084-a375-47e0-a58c-bb0b6ba8dc50-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:31 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c" returned: 0 in 0.730s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0b835c-a5fb-4779-bf87-a4de91a9ca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2bf778-244c-40ee-8efc-64c0af2e409c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01269297-b48f-4703-9f26-0b5f495144d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:31 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Volume volume-1c2bf778-244c-40ee-8efc-64c0af2e409c (1c2bf778-244c-40ee-8efc-64c0af2e409c): created successfully Jul 05 02:54:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01269297-b48f-4703-9f26-0b5f495144d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Flow 'volume_create_manager' (8718f564-508d-439c-81cd-4a93f3c0463a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8b42e5c8-0fb0-4e61-b6d1-9a7119b9a923 tempest-CreateVolumesFromImageTest-738475168 None] Created volume successfully. Jul 05 02:54:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "cinder-1c2bf778-244c-40ee-8efc-64c0af2e409c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-1c2bf778-244c-40ee-8efc-64c0af2e409c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "cinder-quobyte-1c2bf778-244c-40ee-8efc-64c0af2e409c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-quobyte-1c2bf778-244c-40ee-8efc-64c0af2e409c" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:32 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b1a654-562a-41f4-92ed-a03cfec1f1d4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:32 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c Jul 05 02:54:32 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-919b2dd9-5784-451f-91ac-c30d76528322 req-77ae017d-a6df-4d97-93ae-48d33e78f4ec tempest-TestShelveInstance-543445681 None] Terminate volume connection completed successfully. Jul 05 02:54:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-919b2dd9-5784-451f-91ac-c30d76528322 req-77ae017d-a6df-4d97-93ae-48d33e78f4ec tempest-TestShelveInstance-543445681 None] Deleting attachment c6bb4371-a8b5-4d75-8a91-b02466df716f. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:54:33 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c" returned: 0 in 1.001s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:33 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c Jul 05 02:54:33 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:34 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1c2bf778-244c-40ee-8efc-64c0af2e409c" returned: 0 in 0.762s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-quobyte-1c2bf778-244c-40ee-8efc-64c0af2e409c" released by "delete_volume" :: held 1.815s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Created reservations ['54017f91-89ca-4525-a4a2-ad1b313a6a93', 'f92922e6-cb35-4240-9279-fcd9735d7e51', 'ab878138-0db5-4d4c-a3fa-0c6ba5679c35', '446a28b9-410f-44d0-acc5-857f6cda3617'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:34 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:54:34 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "cinder-a76920cf-f27e-4532-86d2-f1a0b393405c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-a76920cf-f27e-4532-86d2-f1a0b393405c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "cinder-quobyte-a76920cf-f27e-4532-86d2-f1a0b393405c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-quobyte-a76920cf-f27e-4532-86d2-f1a0b393405c" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[62019e1c-9b59-4e24-a96e-5acdeca7f43e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:34 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c Jul 05 02:54:34 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:35 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.914s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:35 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:54:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Deleted volume successfully. Jul 05 02:54:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b51c53e9-9ecf-441e-8afc-69349657df31 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-1c2bf778-244c-40ee-8efc-64c0af2e409c-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:35 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c" returned: 0 in 0.871s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:35 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c Jul 05 02:54:35 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:36 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a76920cf-f27e-4532-86d2-f1a0b393405c" returned: 0 in 0.738s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-quobyte-a76920cf-f27e-4532-86d2-f1a0b393405c" released by "delete_volume" :: held 1.658s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Created reservations ['1b888ef7-86c6-4354-9c08-85b65fef7c4c', '5c1523a5-9f0c-4f0c-80f3-9a55e3d726df', '3407ab00-3ed2-4ba2-8968-dc6457b1be53', '7f2e625f-f972-480f-a27b-870176cd18ab'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:36 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:54:36 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "cinder-769c9982-8078-46c1-9474-2379c560f06e-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-769c9982-8078-46c1-9474-2379c560f06e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "cinder-quobyte-769c9982-8078-46c1-9474-2379c560f06e" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-quobyte-769c9982-8078-46c1-9474-2379c560f06e" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9dce4f-1403-437e-86dd-41e136085771]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:37 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e Jul 05 02:54:37 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:37 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.729s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:37 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:54:37 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Deleted volume successfully. Jul 05 02:54:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c8552ac9-b561-48df-96c5-7ce596e5afe5 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-a76920cf-f27e-4532-86d2-f1a0b393405c-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:37 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e" returned: 0 in 0.801s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:37 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e Jul 05 02:54:37 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:38 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-769c9982-8078-46c1-9474-2379c560f06e" returned: 0 in 0.664s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-quobyte-769c9982-8078-46c1-9474-2379c560f06e" released by "delete_volume" :: held 1.518s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Created reservations ['05c4fbd7-3e0f-44de-8eb6-cab947475b5c', '4b05cdbd-e653-4946-bd79-05007b54dae2', 'ad77c65c-94f3-4b5b-b29a-2d86f9d3322f', '1ef9d883-7f4f-4ffc-a930-7c9512f6b949'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:38 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:54:38 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c09f0468-d65e-4d32-b737-99553b4bb088 req-752894b3-4894-43c5-a102-ac5f6215f701 tempest-TestShelveInstance-543445681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c09f0468-d65e-4d32-b737-99553b4bb088 req-752894b3-4894-43c5-a102-ac5f6215f701 tempest-TestShelveInstance-543445681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f94f19-567e-4cb6-8c2d-7a2485d6151e]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c09f0468-d65e-4d32-b737-99553b4bb088 req-752894b3-4894-43c5-a102-ac5f6215f701 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:38 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:54:38 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "cinder-4e599b79-5d2d-4abd-9073-47a049c9c3b1-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Flow 'volume_create_manager' (5bedc502-5e74-47a3-a66f-72f3ce2b888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72626afc-a6c8-42b0-93f2-eb6e8d784aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-4e599b79-5d2d-4abd-9073-47a049c9c3b1-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72626afc-a6c8-42b0-93f2-eb6e8d784aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b963f6a-39c3-4bf6-b897-ab62a7a8d31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107c95b2f484b73aa34546dfff6bdcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:39Z,use_quota=True,user_id='f519976a11144cb9bb6cdbf5e7a4671a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b8eba4-dfd6-4d8e-b259-2bc55db484ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b8eba4-dfd6-4d8e-b259-2bc55db484ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05842bb-61a1-4551-812c-51ceb655b2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.image.glance [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Creating Keystone auth plugin from conf {{(pid=86671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "cinder-quobyte-4e599b79-5d2d-4abd-9073-47a049c9c3b1" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-quobyte-4e599b79-5d2d-4abd-9073-47a049c9c3b1" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2a9b76-41c7-4c18-8f49-32ddc1ce6b7a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:39 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.719s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:54:39 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Deleted volume successfully. Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-63106d68-aa30-47a7-adc0-faacfcc66756 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-769c9982-8078-46c1-9474-2379c560f06e-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:39 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1 Jul 05 02:54:39 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05842bb-61a1-4551-812c-51ceb655b2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b963f6a-39c3-4bf6-b897-ab62a7a8d31d', 'volume_name': 'volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d', 'volume_size': 1, 'image_id': 'e4b71374-1ac4-4207-bf04-0218873e4ae5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4b71374-1ac4-4207-bf04-0218873e4ae5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '059d3257ab7cabed75e3d97bdcdec7c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3107c95b2f484b73aa34546dfff6bdcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e586c0c1024cae3dd8ffbf9d4827944429c487666b37adbd12dd6ea2eb6de3c35b4bb4f0ffed932356b7e58cdc76b5198fddb904ee58c01f4a1a2e725699f341', 'id': 'e4b71374-1ac4-4207-bf04-0218873e4ae5', 'created_at': datetime.datetime(2026, 7, 5, 0, 54, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 54, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4b71374-1ac4-4207-bf04-0218873e4ae5/file', 'properties': {}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01db1e04-0224-4250-95d2-e19415ea5b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01db1e04-0224-4250-95d2-e19415ea5b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df1a8b0-10c5-4e5b-827d-495af306e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:39 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Volume 3b963f6a-39c3-4bf6-b897-ab62a7a8d31d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d', 'volume_size': 1, 'image_id': 'e4b71374-1ac4-4207-bf04-0218873e4ae5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4b71374-1ac4-4207-bf04-0218873e4ae5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '059d3257ab7cabed75e3d97bdcdec7c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3107c95b2f484b73aa34546dfff6bdcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e586c0c1024cae3dd8ffbf9d4827944429c487666b37adbd12dd6ea2eb6de3c35b4bb4f0ffed932356b7e58cdc76b5198fddb904ee58c01f4a1a2e725699f341', 'id': 'e4b71374-1ac4-4207-bf04-0218873e4ae5', 'created_at': datetime.datetime(2026, 7, 5, 0, 54, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 54, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4b71374-1ac4-4207-bf04-0218873e4ae5/file', 'properties': {}}, 'image_service': } Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Trying to clone 3b963f6a-39c3-4bf6-b897-ab62a7a8d31d from image e4b71374-1ac4-4207-bf04-0218873e4ae5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e4b71374-1ac4-4207-bf04-0218873e4ae5', 'metadata': {}}]). {{(pid=86671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 05 02:54:39 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c09f0468-d65e-4d32-b737-99553b4bb088 req-752894b3-4894-43c5-a102-ac5f6215f701 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 0 in 0.888s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c09f0468-d65e-4d32-b737-99553b4bb088 req-752894b3-4894-43c5-a102-ac5f6215f701 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 02:54:39 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Image download 0.00 MB at 0.00 MB/s Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea659617-9371-45e0-a16c-8384682cb189]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:39 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:54:39 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:39 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD Jul 05 02:54:39 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:40 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1" returned: 0 in 0.905s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:40 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1 Jul 05 02:54:40 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:40 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD" returned: 0 in 0.742s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:40 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c09f0468-d65e-4d32-b737-99553b4bb088 req-752894b3-4894-43c5-a102-ac5f6215f701 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 1 in 0.873s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-c09f0468-d65e-4d32-b737-99553b4bb088 req-752894b3-4894-43c5-a102-ac5f6215f701 tempest-TestShelveInstance-543445681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-c09f0468-d65e-4d32-b737-99553b4bb088 req-752894b3-4894-43c5-a102-ac5f6215f701 tempest-TestShelveInstance-543445681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.800s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-c09f0468-d65e-4d32-b737-99553b4bb088 req-752894b3-4894-43c5-a102-ac5f6215f701 tempest-TestShelveInstance-543445681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e', 'name': 'volume-bca9247e-9e7c-4b2c-9e48-f8282677f127', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47daf9e9-7aab-4b12-b96c-da408bf36ea6', 'enforce_multipath': True} {{(pid=86671) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4926}} Jul 05 02:54:40 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD Jul 05 02:54:40 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-c09f0468-d65e-4d32-b737-99553b4bb088 req-752894b3-4894-43c5-a102-ac5f6215f701 tempest-TestShelveInstance-543445681 None] attachment_update completed successfully. Jul 05 02:54:40 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4e599b79-5d2d-4abd-9073-47a049c9c3b1" returned: 0 in 0.646s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-quobyte-4e599b79-5d2d-4abd-9073-47a049c9c3b1" released by "delete_volume" :: held 1.601s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Created reservations ['cecafa4d-6111-4295-99ca-d3c8ae982617', 'ee768a39-9b0f-463b-bb14-eb91c095033d', 'd0f331ac-4565-4ed6-9730-707b732fb60d', '6acd8bea-3405-48ea-8a18-2d995b901b49'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:40 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:54:40 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:41 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD" returned: 1 in 0.790s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Temporary image e4b71374-1ac4-4207-bf04-0218873e4ae5 is fetched for user f519976a11144cb9bb6cdbf5e7a4671a. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac37e15e-5968-479d-bbb7-edb9ef89b0c2]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "cinder-2508586b-6bd3-46c5-98bf-95e75ee200f7-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-2508586b-6bd3-46c5-98bf-95e75ee200f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "cinder-quobyte-2508586b-6bd3-46c5-98bf-95e75ee200f7" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-quobyte-2508586b-6bd3-46c5-98bf-95e75ee200f7" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:41 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD Jul 05 02:54:41 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[369bce5b-573f-484c-b57a-d3976d09ed4e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:41 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7 Jul 05 02:54:41 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:41 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.662s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:54:41 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Deleted volume successfully. Jul 05 02:54:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-39de3117-c863-4b90-90b3-33331b2cb013 tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-4e599b79-5d2d-4abd-9073-47a049c9c3b1-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:42 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD" returned: 0 in 0.793s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:42 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD Jul 05 02:54:42 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:42 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7" returned: 0 in 0.811s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:42 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7 Jul 05 02:54:42 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:42 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD" returned: 1 in 0.778s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b963f6a-39c3-4bf6-b897-ab62a7a8d31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107c95b2f484b73aa34546dfff6bdcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:39Z,use_quota=True,user_id='f519976a11144cb9bb6cdbf5e7a4671a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Creating volume 3b963f6a-39c3-4bf6-b897-ab62a7a8d31d {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:42 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:42 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d 1073741824 Jul 05 02:54:42 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:42 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2508586b-6bd3-46c5-98bf-95e75ee200f7" returned: 0 in 0.677s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-quobyte-2508586b-6bd3-46c5-98bf-95e75ee200f7" released by "delete_volume" :: held 1.533s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Created reservations ['bc82f8cc-db18-42a1-af25-7ad093b47bbf', 'b3691164-6432-4262-91d3-56158de9f5c3', '2d712fac-a3fd-4531-b9f6-5ebcd4c95973', 'f418c34e-3797-4cc4-92e0-0eeb7682c2b8'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:43 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:54:43 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:43 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d 1073741824" returned: 0 in 0.899s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:43 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.708s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:54:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Deleted volume successfully. Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3cad57c9-83c1-45da-bc46-7ac3aa6802fc tempest-CreateVolumesFromImageTest-738475168 None] Lock "cinder-2508586b-6bd3-46c5-98bf-95e75ee200f7-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:43 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d Jul 05 02:54:43 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:44 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d" returned: 0 in 0.734s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:44 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Attempting download of e4b71374-1ac4-4207-bf04-0218873e4ae5 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4b71374-1ac4-4207-bf04-0218873e4ae5', 'metadata': {}}])) to volume 3b963f6a-39c3-4bf6-b897-ab62a7a8d31d. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 02:54:44 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a416d28-984b-4338-851e-36e36af4064b]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4b71374-1ac4-4207-bf04-0218873e4ae5_0ai7m0xf {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:44 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4b71374-1ac4-4207-bf04-0218873e4ae5_0ai7m0xf Jul 05 02:54:44 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:45 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4b71374-1ac4-4207-bf04-0218873e4ae5_0ai7m0xf" returned: 0 in 0.843s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4b71374-1ac4-4207-bf04-0218873e4ae5_0ai7m0xf {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:45 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4b71374-1ac4-4207-bf04-0218873e4ae5_0ai7m0xf Jul 05 02:54:45 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:46 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4b71374-1ac4-4207-bf04-0218873e4ae5_0ai7m0xf" returned: 1 in 0.847s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4b71374-1ac4-4207-bf04-0218873e4ae5_0ai7m0xf' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b9c2d6-1a42-4034-bc95-ea6f75ee886a]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:46 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD Jul 05 02:54:46 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (66a23d0d-d3fb-4963-a818-36183c24914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372af703-b4af-47f2-a7a9-1b9c5928fd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372af703-b4af-47f2-a7a9-1b9c5928fd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-523120029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ab01f9-300d-4a68-b5a5-36555c9c914c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:47Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0489f8cd-e971-4bf6-9eac-234fb6f3b1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0489f8cd-e971-4bf6-9eac-234fb6f3b1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8634a8-c755-43f9-b9d6-9c03fb6013e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af8634a8-c755-43f9-b9d6-9c03fb6013e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ab01f9-300d-4a68-b5a5-36555c9c914c', 'volume_name': 'volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb306e62-d320-4d59-bac3-d9e65fb33cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb306e62-d320-4d59-bac3-d9e65fb33cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c88226-de2c-4308-916e-1adfeb8f6c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:46 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume d8ab01f9-300d-4a68-b5a5-36555c9c914c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c', 'volume_size': 1} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-523120029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ab01f9-300d-4a68-b5a5-36555c9c914c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:47Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Creating volume d8ab01f9-300d-4a68-b5a5-36555c9c914c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:46 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:46 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c 1073741824 Jul 05 02:54:46 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:47 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD" returned: 0 in 0.776s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:47 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD Jul 05 02:54:47 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:47 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c 1073741824" returned: 0 in 0.913s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:47 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c Jul 05 02:54:47 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:47 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD" returned: 1 in 0.780s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:47 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] e4b71374-1ac4-4207-bf04-0218873e4ae5 was raw, converting to raw {{(pid=86671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 02:54:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:47 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d Jul 05 02:54:47 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:48 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c" returned: 0 in 0.688s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c88226-de2c-4308-916e-1adfeb8f6c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a190d9a5-73a9-4c6d-825d-fde04fd773f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:48 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c (d8ab01f9-300d-4a68-b5a5-36555c9c914c): created successfully Jul 05 02:54:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a190d9a5-73a9-4c6d-825d-fde04fd773f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (66a23d0d-d3fb-4963-a818-36183c24914a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:48 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-bb02c3f1-150c-4417-8706-d330a62da6c6 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created volume successfully. Jul 05 02:54:48 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d" returned: 0 in 0.817s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:48 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e4b71374-1ac4-4207-bf04-0218873e4ae5_mfe8yrg7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:54:48 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 02:54:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:48 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d 1G Jul 05 02:54:48 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (6c555fab-9e43-4760-b333-ecf0da7230c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69868baf-c391-4aad-95ee-5c7b68edfe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69868baf-c391-4aad-95ee-5c7b68edfe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-265261851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ce794a-cb38-44b7-9af9-f97ad4bb9d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:49Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7352af-70a4-4ebe-9ed6-c7be762615d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7352af-70a4-4ebe-9ed6-c7be762615d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0635b68e-f41d-4ec8-b30b-ee7f00bbd56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0635b68e-f41d-4ec8-b30b-ee7f00bbd56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ce794a-cb38-44b7-9af9-f97ad4bb9d10', 'volume_name': 'volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1671ca-1e76-4999-89dc-0036bbe72c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1671ca-1e76-4999-89dc-0036bbe72c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2163ff48-7f36-442d-8f28-b9ab8ce0489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:49 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume a6ce794a-cb38-44b7-9af9-f97ad4bb9d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10', 'volume_size': 1} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-265261851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ce794a-cb38-44b7-9af9-f97ad4bb9d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:49Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Creating volume a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:49 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:49 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 1073741824 Jul 05 02:54:49 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:49 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d 1G" returned: 0 in 0.721s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0d5de3-d54f-4ae6-a916-74e5d81f35b7]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:49 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d Jul 05 02:54:49 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (246622cc-209f-4055-92ce-b1b1b9b4fcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a9e2f9-4987-408c-a13e-fd26fc0af443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a9e2f9-4987-408c-a13e-fd26fc0af443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276467406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e136551-1478-4859-9d74-18705a134e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:50Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2260c87b-6115-4ab3-8220-d9dc795f7351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2260c87b-6115-4ab3-8220-d9dc795f7351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a30ea18-6a49-4d1d-8dd4-a8ff0c801c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a30ea18-6a49-4d1d-8dd4-a8ff0c801c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e136551-1478-4859-9d74-18705a134e73', 'volume_name': 'volume-2e136551-1478-4859-9d74-18705a134e73', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1e2e0f-be4d-4447-a842-0c6f771176f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1e2e0f-be4d-4447-a842-0c6f771176f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c6a0cb-8c22-407f-b61f-4bc4f2c37035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:50 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume 2e136551-1478-4859-9d74-18705a134e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e136551-1478-4859-9d74-18705a134e73', 'volume_size': 1} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (fa733eee-f3a9-4d05-8f81-b913f8e31ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2127badd-df79-4056-b78b-7428d8efddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2127badd-df79-4056-b78b-7428d8efddf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574744239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6311dcd8-c3c0-4adc-8791-74ef7b95e5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:50Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0e6d0b-8c26-479a-920a-202b9904825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0e6d0b-8c26-479a-920a-202b9904825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac0002a-80bf-4414-8800-4dfe83988572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac0002a-80bf-4414-8800-4dfe83988572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6311dcd8-c3c0-4adc-8791-74ef7b95e5b6', 'volume_name': 'volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a30b44e-0036-4e23-985e-f472b3035388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a30b44e-0036-4e23-985e-f472b3035388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b426af-ddd5-4fc3-94e6-81172bb92351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:50 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume 6311dcd8-c3c0-4adc-8791-74ef7b95e5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6', 'volume_size': 1} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:50 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d" returned: 0 in 1.395s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:51 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 1073741824" returned: 0 in 1.650s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:51 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 Jul 05 02:54:51 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:51 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d Jul 05 02:54:51 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (142f51ed-d28b-42be-9ec8-fd77d606c9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a856d0a-1c89-447f-a52d-895a45f678eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a856d0a-1c89-447f-a52d-895a45f678eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1985908054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fb740a-3dfc-47a1-a36a-d9c2f153fa73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:51Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce2b13b-fcd9-48a7-b68f-ad36ad700582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce2b13b-fcd9-48a7-b68f-ad36ad700582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84d0200-0242-4d44-94c2-ec8627812f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84d0200-0242-4d44-94c2-ec8627812f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fb740a-3dfc-47a1-a36a-d9c2f153fa73', 'volume_name': 'volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1814d27f-2994-43f5-8ebe-a760960e1b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1814d27f-2994-43f5-8ebe-a760960e1b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc9177d-8984-4e43-97a6-fc8bed0a6d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:51 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume a2fb740a-3dfc-47a1-a36a-d9c2f153fa73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73', 'volume_size': 1} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (9bd7a588-50c8-445f-9ea8-2fdbf31f423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37b418d-57e2-4a9d-bb0d-354c1073e3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37b418d-57e2-4a9d-bb0d-354c1073e3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1242370130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd657c7-77a1-4e8a-964b-cecf12be099c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:52Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c38b34-231b-4e19-b6a2-7f4806812a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c38b34-231b-4e19-b6a2-7f4806812a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbf11da-9959-4cbe-bb80-769722424e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fbf11da-9959-4cbe-bb80-769722424e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd657c7-77a1-4e8a-964b-cecf12be099c', 'volume_name': 'volume-4fd657c7-77a1-4e8a-964b-cecf12be099c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecd57b8-3dfb-42d7-809f-ac68e41a1de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecd57b8-3dfb-42d7-809f-ac68e41a1de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d8c293-1f6a-44a5-9d22-ead3c4323c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:51 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume 4fd657c7-77a1-4e8a-964b-cecf12be099c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd657c7-77a1-4e8a-964b-cecf12be099c', 'volume_size': 1} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:51 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10" returned: 0 in 0.930s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] <== create_volume: return (2638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.640s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.620s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1276467406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e136551-1478-4859-9d74-18705a134e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:50Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Creating volume 2e136551-1478-4859-9d74-18705a134e73 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:52 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2163ff48-7f36-442d-8f28-b9ab8ce0489e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:52 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:52 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73 1073741824 Jul 05 02:54:52 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb3069e1-a12e-4a26-8deb-3d7092012ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d" returned: 1 in 1.074s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Downloaded image e4b71374-1ac4-4207-bf04-0218873e4ae5 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4b71374-1ac4-4207-bf04-0218873e4ae5', 'metadata': {}}])) to volume 3b963f6a-39c3-4bf6-b897-ab62a7a8d31d successfully. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Temporary image e4b71374-1ac4-4207-bf04-0218873e4ae5 for user f519976a11144cb9bb6cdbf5e7a4671a is deleted. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Marking volume 3b963f6a-39c3-4bf6-b897-ab62a7a8d31d as bootable. {{(pid=86671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 02:54:52 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 (a6ce794a-cb38-44b7-9af9-f97ad4bb9d10): created successfully Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb3069e1-a12e-4a26-8deb-3d7092012ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (6c555fab-9e43-4760-b333-ecf0da7230c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Copying metadata from image e4b71374-1ac4-4207-bf04-0218873e4ae5 to 3b963f6a-39c3-4bf6-b897-ab62a7a8d31d. {{(pid=86671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Creating volume glance metadata for volume 3b963f6a-39c3-4bf6-b897-ab62a7a8d31d backed by image e4b71374-1ac4-4207-bf04-0218873e4ae5 with: {'image_id': 'e4b71374-1ac4-4207-bf04-0218873e4ae5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '059d3257ab7cabed75e3d97bdcdec7c0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 02:54:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-aa06dc9c-dded-4908-be34-9b280791d319 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created volume successfully. Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df1a8b0-10c5-4e5b-827d-495af306e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d', 'volume_size': 1, 'image_id': 'e4b71374-1ac4-4207-bf04-0218873e4ae5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4b71374-1ac4-4207-bf04-0218873e4ae5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '059d3257ab7cabed75e3d97bdcdec7c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3107c95b2f484b73aa34546dfff6bdcc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e586c0c1024cae3dd8ffbf9d4827944429c487666b37adbd12dd6ea2eb6de3c35b4bb4f0ffed932356b7e58cdc76b5198fddb904ee58c01f4a1a2e725699f341', 'id': 'e4b71374-1ac4-4207-bf04-0218873e4ae5', 'created_at': datetime.datetime(2026, 7, 5, 0, 54, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 54, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4b71374-1ac4-4207-bf04-0218873e4ae5/file', 'properties': {}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679fc8ff-e6e8-47ab-96d2-2c5980cb614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:52 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Volume volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d (3b963f6a-39c3-4bf6-b897-ab62a7a8d31d): created successfully Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679fc8ff-e6e8-47ab-96d2-2c5980cb614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Flow 'volume_create_manager' (5bedc502-5e74-47a3-a66f-72f3ce2b888e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ec401a7e-1002-490e-b0fe-b3a6e193fdf5 tempest-VolumeImageDependencyTests-1031545086 None] Created volume successfully. Jul 05 02:54:52 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73 1073741824" returned: 0 in 0.912s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:53 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73 Jul 05 02:54:53 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Acquiring lock "cinder-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Lock "cinder-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Acquiring lock "cinder-quobyte-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Lock "cinder-quobyte-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d" acquired by "delete_volume" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa603b97-62bb-4f4b-8245-a79b17321d14]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:53 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d Jul 05 02:54:53 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:53 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73" returned: 0 in 0.818s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.990s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574744239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6311dcd8-c3c0-4adc-8791-74ef7b95e5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:50Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Creating volume 6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:53 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:53 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 1073741824 Jul 05 02:54:53 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c6a0cb-8c22-407f-b61f-4bc4f2c37035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e136551-1478-4859-9d74-18705a134e73', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8280ae53-2719-4d52-ad83-575c706dce61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:53 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume volume-2e136551-1478-4859-9d74-18705a134e73 (2e136551-1478-4859-9d74-18705a134e73): created successfully Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8280ae53-2719-4d52-ad83-575c706dce61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (246622cc-209f-4055-92ce-b1b1b9b4fcc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:53 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-595fae61-ec2d-4bb6-bc30-bcc577bb4a03 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created volume successfully. Jul 05 02:54:54 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d" returned: 0 in 0.899s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:54 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d Jul 05 02:54:54 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:54 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 1073741824" returned: 0 in 0.897s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:54 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 Jul 05 02:54:54 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:55 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d" returned: 1 in 0.856s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:55 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d Jul 05 02:54:55 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:55 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6" returned: 0 in 0.729s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.088s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1985908054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fb740a-3dfc-47a1-a36a-d9c2f153fa73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:51Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Creating volume a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:55 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b426af-ddd5-4fc3-94e6-81172bb92351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:55 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 1073741824 Jul 05 02:54:55 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5de5d0c-43f1-4031-86bf-a3725783f122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:55 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 (6311dcd8-c3c0-4adc-8791-74ef7b95e5b6): created successfully Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5de5d0c-43f1-4031-86bf-a3725783f122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (fa733eee-f3a9-4d05-8f81-b913f8e31ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:55 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f2d66b97-d2d6-40f3-8904-f2614e73e789 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created volume successfully. Jul 05 02:54:55 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d" returned: 0 in 0.708s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Lock "cinder-quobyte-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d" released by "delete_volume" :: held 2.549s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:55 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Created reservations ['a2849369-2eb2-4de6-9717-e9feaded810a', '92b35aff-f378-4f31-be3d-ec236d3f58eb', '64b0adad-a818-4ea2-a484-dbf0516e1cbb', '21d88714-3235-40ef-bcb1-1dfbc4a1ad66'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:56 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:54:56 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:56 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 1073741824" returned: 0 in 0.945s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:56 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 Jul 05 02:54:56 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:56 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.760s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:54:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Deleted volume successfully. Jul 05 02:54:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6377a10f-d0d5-4356-8427-73deda5ee705 tempest-VolumeImageDependencyTests-1031545086 None] Lock "cinder-3b963f6a-39c3-4bf6-b897-ab62a7a8d31d-delete_volume" released by "delete_volume" :: held 3.657s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:54:57 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73" returned: 0 in 0.775s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.542s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1242370130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd657c7-77a1-4e8a-964b-cecf12be099c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c5fbb59e81438882ecf8c67df2b7f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:54:52Z,use_quota=True,user_id='73953c4a8ad24538892752a7105e5362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Creating volume 4fd657c7-77a1-4e8a-964b-cecf12be099c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:54:57 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:57 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c 1073741824 Jul 05 02:54:57 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc9177d-8984-4e43-97a6-fc8bed0a6d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5909a12b-ab26-4ccb-a3c4-b7205080cfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:57 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 (a2fb740a-3dfc-47a1-a36a-d9c2f153fa73): created successfully Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5909a12b-ab26-4ccb-a3c4-b7205080cfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (142f51ed-d28b-42be-9ec8-fd77d606c9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ba1edc27-dc50-45b2-91e5-c6288ad24c78 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created volume successfully. Jul 05 02:54:58 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c 1073741824" returned: 0 in 1.113s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:58 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c Jul 05 02:54:58 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:54:59 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c" returned: 0 in 0.666s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d8c293-1f6a-44a5-9d22-ead3c4323c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd657c7-77a1-4e8a-964b-cecf12be099c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17f4c74-107b-420c-905a-7dc3d293a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:54:59 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Volume volume-4fd657c7-77a1-4e8a-964b-cecf12be099c (4fd657c7-77a1-4e8a-964b-cecf12be099c): created successfully Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17f4c74-107b-420c-905a-7dc3d293a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Flow 'volume_create_manager' (9bd7a588-50c8-445f-9ea8-2fdbf31f423e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:54:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e161686b-3e49-48c8-8e5e-0f44c5796e26 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created volume successfully. Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-4fd657c7-77a1-4e8a-964b-cecf12be099c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-4fd657c7-77a1-4e8a-964b-cecf12be099c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-quobyte-4fd657c7-77a1-4e8a-964b-cecf12be099c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-4fd657c7-77a1-4e8a-964b-cecf12be099c" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1da1e1-9952-4ee4-a5d2-ea4677333186]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:54:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:54:59 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c Jul 05 02:54:59 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:00 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c" returned: 0 in 0.862s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:00 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c Jul 05 02:55:00 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:01 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4fd657c7-77a1-4e8a-964b-cecf12be099c" returned: 0 in 0.772s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-4fd657c7-77a1-4e8a-964b-cecf12be099c" released by "delete_volume" :: held 1.685s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created reservations ['fdfdee0a-b852-4086-b122-4551d98d2bdd', '66eaf1d8-4a6e-4d6d-bb62-f0ba7302cf72', 'a9dc2b8a-14c8-4244-8e29-a2af9ed37715', 'c5c8df05-33aa-4195-8c55-d6d2fa01cb68'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:01 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:01 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-quobyte-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f267c57-0509-40da-b278-333ee15a3473]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:02 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 Jul 05 02:55:02 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:02 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.950s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:02 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:02 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Deleted volume successfully. Jul 05 02:55:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-69f9cea1-6c2b-4b7f-ae21-0ceb2b3f5240 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-4fd657c7-77a1-4e8a-964b-cecf12be099c-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:02 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73" returned: 0 in 1.107s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:02 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73 Jul 05 02:55:03 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:03 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73" returned: 0 in 0.710s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73" released by "delete_volume" :: held 1.859s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:03 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created reservations ['42ce87c1-25ce-4bfe-8414-789f78264f8a', '6fe118ba-bbf7-4e88-a5f0-b9d4f74b74b3', '5c06bbe1-1405-40c2-8124-26b5558a6d73', '4b60861a-a0c0-45c1-b046-e80c666b0087'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:03 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:03 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-quobyte-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e210984-9ee2-4ea9-a9c4-d30cba7ef0f4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:04 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 Jul 05 02:55:04 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:04 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.792s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:04 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Deleted volume successfully. Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e8e5dbd8-f393-4b67-9196-9092d337c8e9 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-a2fb740a-3dfc-47a1-a36a-d9c2f153fa73-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:04 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6" returned: 0 in 0.774s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:05 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6 Jul 05 02:55:05 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:55:05 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6" returned: 0 in 0.679s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6" released by "delete_volume" :: held 1.505s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=90,cinder:INSERT=32,cinder:UPDATE=149,cinder:DELETE=12 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=113,cinder:UPDATE=116,cinder:INSERT=44,cinder:DELETE=12 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created reservations ['403c91ce-bd4d-470a-b336-c5fb626e7a36', 'abc198b3-09ac-4b1a-99b5-93d90cfac4f7', '89e7cc07-0c29-4417-9b5a-f355b4af96bd', '0d81af32-445d-4787-89ce-dcc440ea6d23'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:05 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:05 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-2e136551-1478-4859-9d74-18705a134e73-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-2e136551-1478-4859-9d74-18705a134e73-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-quobyte-2e136551-1478-4859-9d74-18705a134e73" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-2e136551-1478-4859-9d74-18705a134e73" acquired by "delete_volume" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:06 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ff7f1e-b0b3-4437-96a9-9bdf98c8363b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:06 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.773s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:06 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Deleted volume successfully. Jul 05 02:55:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-46822ba6-c7b6-4567-a254-b0f293e5151a tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-6311dcd8-c3c0-4adc-8791-74ef7b95e5b6-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:06 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73 Jul 05 02:55:06 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:07 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73" returned: 0 in 0.808s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:07 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73 Jul 05 02:55:07 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:07 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2e136551-1478-4859-9d74-18705a134e73" returned: 0 in 0.665s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-2e136551-1478-4859-9d74-18705a134e73" released by "delete_volume" :: held 1.526s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created reservations ['623ddcdc-e216-472c-902e-570883cd16d3', 'c88cefd9-4e8b-47de-bdc2-0b45ede2d426', 'f99f43de-bfa3-493b-9baa-dd5b47bcc1db', 'bac7e5bd-a72a-4e9f-9b6e-3b4362ac366e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:08 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:08 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-quobyte-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[554dcd01-aade-400e-a527-3a271a0ed2c3]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:08 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.692s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:08 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Deleted volume successfully. Jul 05 02:55:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4c529be2-7af3-41ad-8040-4d0c0eeaf138 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-2e136551-1478-4859-9d74-18705a134e73-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:08 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 Jul 05 02:55:08 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:09 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10" returned: 0 in 0.777s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:09 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10 Jul 05 02:55:09 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:10 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10" returned: 0 in 0.655s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10" released by "delete_volume" :: held 1.472s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created reservations ['aee3d557-3f1a-4727-8ebe-7817a6bb22a1', '73390696-81be-42f5-99e5-aac3d3e34c27', '54dfc284-1ae8-4308-adb3-ca554f03bae2', 'ed343be0-e72b-4a3e-b98a-635eeba3498e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:10 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:10 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-d8ab01f9-300d-4a68-b5a5-36555c9c914c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-d8ab01f9-300d-4a68-b5a5-36555c9c914c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "cinder-quobyte-d8ab01f9-300d-4a68-b5a5-36555c9c914c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-d8ab01f9-300d-4a68-b5a5-36555c9c914c" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14e7afd-05ce-4242-99bb-7a5501845bad]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:10 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.674s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:10 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:10 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Deleted volume successfully. Jul 05 02:55:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3a6c6173-dc9d-4380-94f9-0dfaa5ee5a58 tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-a6ce794a-cb38-44b7-9af9-f97ad4bb9d10-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:11 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c Jul 05 02:55:11 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:11 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c" returned: 0 in 0.751s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:11 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c Jul 05 02:55:11 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:12 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d8ab01f9-300d-4a68-b5a5-36555c9c914c" returned: 0 in 0.661s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-quobyte-d8ab01f9-300d-4a68-b5a5-36555c9c914c" released by "delete_volume" :: held 1.462s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:12 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Created reservations ['143096a2-2d2b-4808-a4ec-7e06c03881d4', 'c13bb15d-8b96-4c1c-911a-ddbe4f1377f0', '30791430-4991-4153-aefa-6e6cb7890cd3', '4d5dd35b-8ac1-4f13-9baf-9d8f520a2a68'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:12 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:12 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:13 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.675s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:13 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Deleted volume successfully. Jul 05 02:55:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9de287a1-f27d-4cb4-9898-adc0641e3f1b tempest-CreateVolumesFromSourceVolumeTest-786031050 None] Lock "cinder-d8ab01f9-300d-4a68-b5a5-36555c9c914c-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Flow 'volume_create_manager' (55421978-ab3e-4c99-9563-bab099ea0e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2760a3b6-acde-4081-a706-b8cb19ef0b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2760a3b6-acde-4081-a706-b8cb19ef0b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075187908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faece636c034e7f89777bbb13f28bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:17Z,use_quota=True,user_id='3b8c1f22d1ae411c818a4318ab2e3e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e841b89-8232-46d1-8cbf-00c0ff5229e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e841b89-8232-46d1-8cbf-00c0ff5229e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86198c2-6397-4a20-ab3c-46afd90bec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86198c2-6397-4a20-ab3c-46afd90bec4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184', 'volume_name': 'volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21146238-bcb5-4284-a524-d964bf699212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21146238-bcb5-4284-a524-d964bf699212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299d4f64-1a96-4042-a9be-11a9fac8de46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:16 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Volume 4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184', 'volume_size': 1} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075187908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faece636c034e7f89777bbb13f28bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:17Z,use_quota=True,user_id='3b8c1f22d1ae411c818a4318ab2e3e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Creating volume 4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:55:16 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:55:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:16 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 1073741824 Jul 05 02:55:16 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:17 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 1073741824" returned: 0 in 0.869s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:17 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 Jul 05 02:55:17 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:18 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184" returned: 0 in 0.801s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299d4f64-1a96-4042-a9be-11a9fac8de46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b9cecd-0050-4bfa-b813-9dc1c8e51d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:18 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Volume volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 (4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184): created successfully Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b9cecd-0050-4bfa-b813-9dc1c8e51d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Flow 'volume_create_manager' (55421978-ab3e-4c99-9563-bab099ea0e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-146df787-a376-4716-b1af-0a9799df4666 tempest-ProjectReaderTests-1330122522 None] Created volume successfully. Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Acquiring lock "cinder-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Lock "cinder-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Acquiring lock "cinder-quobyte-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Lock "cinder-quobyte-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[af41005b-7cb8-49bb-bc5a-f6a290a8449d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:19 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 Jul 05 02:55:19 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:19 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184" returned: 0 in 0.783s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:19 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184 Jul 05 02:55:19 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-ae97c605-d0df-44aa-bd8a-539269926432 tempest-TestShelveInstance-543445681 None] Terminate volume connection completed successfully. Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-ae97c605-d0df-44aa-bd8a-539269926432 tempest-TestShelveInstance-543445681 None] Deleting attachment 47daf9e9-7aab-4b12-b96c-da408bf36ea6. {{(pid=86671) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5057}} Jul 05 02:55:20 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184" returned: 0 in 0.676s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Lock "cinder-quobyte-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184" released by "delete_volume" :: held 1.501s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Created reservations ['f7ec35d8-ef96-4b44-834c-886c80369099', '1f6d7061-4e2f-46f5-864e-1803fd30c1f0', '7f0afe28-3f0c-4c12-a1fc-abf3ecef62e9', '3aaac5ca-ea7b-4b92-9fcd-1083662e06e3'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:20 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:20 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Acquiring lock "cinder-bca9247e-9e7c-4b2c-9e48-f8282677f127-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Lock "cinder-bca9247e-9e7c-4b2c-9e48-f8282677f127-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Acquiring lock "cinder-quobyte-bca9247e-9e7c-4b2c-9e48-f8282677f127" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Lock "cinder-quobyte-bca9247e-9e7c-4b2c-9e48-f8282677f127" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dbb9f2-43c4-4ff9-9588-b1543b3adc65]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:21 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:55:21 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:21 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.708s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Deleted volume successfully. Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-85c3ad05-1398-4782-ac3d-6ec12666f034 tempest-ProjectReaderTests-1330122522 None] Lock "cinder-4a5e7c6c-afdd-49cf-bdb0-7d125ef1a184-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Flow 'volume_create_manager' (f770d42c-e8b4-4595-8e12-0dc127d083a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6377aa49-3cdb-4ce9-bd81-9ce57008041d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6377aa49-3cdb-4ce9-bd81-9ce57008041d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207611181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033ab057-7c66-4b2b-b327-843301bc3c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faece636c034e7f89777bbb13f28bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:22Z,use_quota=True,user_id='3b8c1f22d1ae411c818a4318ab2e3e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3192d1-29b6-42f1-bc39-2325d22e1c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3192d1-29b6-42f1-bc39-2325d22e1c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2ddc19-3f3f-47d2-aabd-697ee4823fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2ddc19-3f3f-47d2-aabd-697ee4823fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '033ab057-7c66-4b2b-b327-843301bc3c1f', 'volume_name': 'volume-033ab057-7c66-4b2b-b327-843301bc3c1f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab67ef7e-0c4c-44f5-87df-4c6ef0ee5c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab67ef7e-0c4c-44f5-87df-4c6ef0ee5c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81554534-975a-42c0-9e94-ef64ca90d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:21 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Volume 033ab057-7c66-4b2b-b327-843301bc3c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-033ab057-7c66-4b2b-b327-843301bc3c1f', 'volume_size': 1} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207611181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033ab057-7c66-4b2b-b327-843301bc3c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faece636c034e7f89777bbb13f28bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:22Z,use_quota=True,user_id='3b8c1f22d1ae411c818a4318ab2e3e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Creating volume 033ab057-7c66-4b2b-b327-843301bc3c1f {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:55:21 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:21 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f 1073741824 Jul 05 02:55:21 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:21 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 0 in 0.831s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:21 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:55:21 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:22 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 1 in 0.781s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:55:22 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f 1073741824" returned: 0 in 0.864s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:22 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127 Jul 05 02:55:22 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:22 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f Jul 05 02:55:22 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:23 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bca9247e-9e7c-4b2c-9e48-f8282677f127" returned: 0 in 0.684s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:23 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Lock "cinder-quobyte-bca9247e-9e7c-4b2c-9e48-f8282677f127" released by "delete_volume" :: held 2.369s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f" returned: 0 in 0.649s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81554534-975a-42c0-9e94-ef64ca90d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-033ab057-7c66-4b2b-b327-843301bc3c1f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6866adee-8860-461c-b188-f62c93983d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:23 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Volume volume-033ab057-7c66-4b2b-b327-843301bc3c1f (033ab057-7c66-4b2b-b327-843301bc3c1f): created successfully Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6866adee-8860-461c-b188-f62c93983d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Flow 'volume_create_manager' (f770d42c-e8b4-4595-8e12-0dc127d083a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:23 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-80f0b032-0814-4138-8288-ae0fa3bbf0f0 tempest-ProjectReaderTests-1330122522 None] Created volume successfully. Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.quota [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Created reservations ['83f47452-32e6-4759-8a19-724842095c24', '3c666a3f-1d3b-46a8-8eb8-3d3ef70d7221', '5be1783e-791e-49d6-9ddb-353a2482f9e5', 'df8e5f94-ace6-4d61-ae5b-703f20fc002b'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:23 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:23 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Acquiring lock "cinder-033ab057-7c66-4b2b-b327-843301bc3c1f-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Lock "cinder-033ab057-7c66-4b2b-b327-843301bc3c1f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Acquiring lock "cinder-quobyte-033ab057-7c66-4b2b-b327-843301bc3c1f" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Lock "cinder-quobyte-033ab057-7c66-4b2b-b327-843301bc3c1f" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5814cd9-e9f1-4e35-9536-53440abc677e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:23 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f Jul 05 02:55:23 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.714s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:24 devstack cinder-volume[86671]: DEBUG cinder.manager [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:24 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Deleted volume successfully. Jul 05 02:55:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [req-4260c85c-afb7-4e0f-8853-b12c96c035e0 req-aae4ffcc-d112-43eb-abd0-9658179a9d13 tempest-TestShelveInstance-543445681 None] Lock "cinder-bca9247e-9e7c-4b2c-9e48-f8282677f127-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:24 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f" returned: 0 in 0.781s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:24 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f Jul 05 02:55:24 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:25 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-033ab057-7c66-4b2b-b327-843301bc3c1f" returned: 0 in 0.670s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Lock "cinder-quobyte-033ab057-7c66-4b2b-b327-843301bc3c1f" released by "delete_volume" :: held 1.496s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:25 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Created reservations ['21ab2dfc-24fc-4e04-8c67-a7064e1f0b06', '90588f2d-4074-4b78-9855-0b4a25b61ea1', '55c42903-6062-43ae-bd2e-889eb0534edd', '366433a8-5a19-4226-a6aa-934e1a19853b'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:25 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:25 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:26 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.705s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:26 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Deleted volume successfully. Jul 05 02:55:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1651afae-8d0c-4627-a3e2-aa84eee730a9 tempest-ProjectReaderTests-1330122522 None] Lock "cinder-033ab057-7c66-4b2b-b327-843301bc3c1f-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (a8beafb0-6986-434d-827d-28d5f3a47e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c901543-39f2-4f9e-918f-2bbe2f52f852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c901543-39f2-4f9e-918f-2bbe2f52f852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-466704400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c634c7ac-2681-4228-9611-e4b490e7ead7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:35Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa9fa19-d7ab-470c-857e-3c003d1c4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa9fa19-d7ab-470c-857e-3c003d1c4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bf1111-96e4-439c-8aea-af3b5424e8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bf1111-96e4-439c-8aea-af3b5424e8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c634c7ac-2681-4228-9611-e4b490e7ead7', 'volume_name': 'volume-c634c7ac-2681-4228-9611-e4b490e7ead7', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006834e4-4866-417f-90c3-adf6ee7c2d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006834e4-4866-417f-90c3-adf6ee7c2d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6688c460-c1c0-40d6-b6f4-88583922b570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:34 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume c634c7ac-2681-4228-9611-e4b490e7ead7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c634c7ac-2681-4228-9611-e4b490e7ead7', 'volume_size': 1} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-466704400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c634c7ac-2681-4228-9611-e4b490e7ead7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:35Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Creating volume c634c7ac-2681-4228-9611-e4b490e7ead7 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:55:34 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:55:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:34 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 1073741824 Jul 05 02:55:34 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:35 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 1073741824" returned: 0 in 0.781s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:35 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 Jul 05 02:55:35 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:36 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7" returned: 0 in 0.634s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6688c460-c1c0-40d6-b6f4-88583922b570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c634c7ac-2681-4228-9611-e4b490e7ead7', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777ef3da-fbb7-4c0d-8b48-28b1cf259732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:36 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume volume-c634c7ac-2681-4228-9611-e4b490e7ead7 (c634c7ac-2681-4228-9611-e4b490e7ead7): created successfully Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777ef3da-fbb7-4c0d-8b48-28b1cf259732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (a8beafb0-6986-434d-827d-28d5f3a47e96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e3fda356-4c73-487a-a77f-e58ee6b170df tempest-CreateVolumesFromSnapshotTest-562585096 None] Created volume successfully. Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Creating offline snapshot b731c67d-34c0-4ac6-9b64-b7eabd465f41 of volume c634c7ac-2681-4228-9611-e4b490e7ead7 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8eeb7-4b3e-4360-9d66-e3fd9bc2fb1a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:36 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 Jul 05 02:55:36 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:37 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7" returned: 0 in 0.756s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:37 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 1G Jul 05 02:55:37 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:38 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 1G" returned: 0 in 0.767s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c634c7ac-2681-4228-9611-e4b490e7ead7 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:38 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c634c7ac-2681-4228-9611-e4b490e7ead7 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 Jul 05 02:55:38 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:39 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c634c7ac-2681-4228-9611-e4b490e7ead7 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41" returned: 0 in 0.686s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:39 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 is being set with open permissions: ugo+rw Jul 05 02:55:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:39 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 Jul 05 02:55:39 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:39 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41" returned: 0 in 0.631s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:39 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.info Jul 05 02:55:39 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:40 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.info" returned: 0 in 0.632s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:40 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.info is being set with open permissions: ugo+rw Jul 05 02:55:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:40 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.info Jul 05 02:55:40 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:40 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.info" returned: 0 in 0.642s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.195s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:41 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-70ebc745-a106-46ca-b49a-e8830b05459b tempest-CreateVolumesFromSnapshotTest-562585096 None] Create snapshot completed successfully Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (b45f37d9-3e40-4f01-8865-40ef9a92e997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8982a7ba-3493-453c-b36c-6c552be01e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8982a7ba-3493-453c-b36c-6c552be01e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374623470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786bf74d-cd98-419b-88d0-52ac18adb423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:42Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e122380d-1564-47d7-9a18-2026b616e9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e122380d-1564-47d7-9a18-2026b616e9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff8ce24-1c1e-4ac7-90a2-90c5abdc4c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff8ce24-1c1e-4ac7-90a2-90c5abdc4c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786bf74d-cd98-419b-88d0-52ac18adb423', 'volume_name': 'volume-786bf74d-cd98-419b-88d0-52ac18adb423', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea79a666-b1d0-4c8d-9982-c397f896e093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea79a666-b1d0-4c8d-9982-c397f896e093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8439366-9acf-4d37-a1e8-81bf988bb18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:42 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume 786bf74d-cd98-419b-88d0-52ac18adb423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786bf74d-cd98-419b-88d0-52ac18adb423', 'volume_size': 1} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374623470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786bf74d-cd98-419b-88d0-52ac18adb423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:42Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Creating volume 786bf74d-cd98-419b-88d0-52ac18adb423 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:55:42 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:42 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423 1073741824 Jul 05 02:55:42 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (b24a5173-cbdf-44d4-a696-b134aae863b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133d3afc-036c-4c18-9344-be53f63eea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (133d3afc-036c-4c18-9344-be53f63eea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-412969142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e40664e-d2dc-4dce-99df-888feb95fad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:43Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be9e731-272d-48b6-92c8-a3307ff8691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be9e731-272d-48b6-92c8-a3307ff8691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80026c2-cf64-4e82-a0c4-ce930015fbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80026c2-cf64-4e82-a0c4-ce930015fbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e40664e-d2dc-4dce-99df-888feb95fad9', 'volume_name': 'volume-3e40664e-d2dc-4dce-99df-888feb95fad9', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be0375a-fcc3-4595-a5b8-9ed7903986aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be0375a-fcc3-4595-a5b8-9ed7903986aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef1dc32-bab1-49c8-8830-3851cf5a054b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:42 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume 3e40664e-d2dc-4dce-99df-888feb95fad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e40664e-d2dc-4dce-99df-888feb95fad9', 'volume_size': 1} Jul 05 02:55:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (0b51e305-9c12-4154-92ad-bab42c02abdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4bdf9a-88a4-42f7-8ee5-89392a97aabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4bdf9a-88a4-42f7-8ee5-89392a97aabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-624127465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2065b195-3c54-457f-ab43-d2a69d860682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:43Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be5282c-659f-4568-b24d-54cad566e661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be5282c-659f-4568-b24d-54cad566e661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f18493-179a-4567-a23c-274de480b471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f18493-179a-4567-a23c-274de480b471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2065b195-3c54-457f-ab43-d2a69d860682', 'volume_name': 'volume-2065b195-3c54-457f-ab43-d2a69d860682', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833e410c-8c25-420f-adfc-828cb3f0a699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833e410c-8c25-420f-adfc-828cb3f0a699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39bd844-013a-4d76-8f72-130c418041a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume 2065b195-3c54-457f-ab43-d2a69d860682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2065b195-3c54-457f-ab43-d2a69d860682', 'volume_size': 1} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:43 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423 1073741824" returned: 0 in 0.947s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (a99047b1-72b9-409b-a565-6b0e931061c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90549f9c-3172-47f6-b3c6-fc524b678d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90549f9c-3172-47f6-b3c6-fc524b678d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-438108067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b46af0-b1d9-488d-9cb6-9471a63fbde9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:43Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b74966f-4ba8-44f5-96fa-3a81a5d40612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b74966f-4ba8-44f5-96fa-3a81a5d40612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94db52a-6868-41ad-a6cf-078d27f38224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94db52a-6868-41ad-a6cf-078d27f38224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b46af0-b1d9-488d-9cb6-9471a63fbde9', 'volume_name': 'volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57d9cc0-2bf5-4a2a-82bc-c6289bf7bbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57d9cc0-2bf5-4a2a-82bc-c6289bf7bbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc696251-e776-493d-821a-cba66ea8848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume c6b46af0-b1d9-488d-9cb6-9471a63fbde9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9', 'volume_size': 1} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:43 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423 Jul 05 02:55:43 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (1c86146e-6140-4c9c-a65f-633183ba94ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db29ece-bf5e-4832-a115-8683195d0ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4db29ece-bf5e-4832-a115-8683195d0ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-573408725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91bb61b4-87cd-43e3-aa82-0eb35a33b35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:44Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b99af69-5bc2-49a3-88fd-6fcadff6e031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b99af69-5bc2-49a3-88fd-6fcadff6e031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adec1fe-75f4-47e6-9086-2fcb70ea466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adec1fe-75f4-47e6-9086-2fcb70ea466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91bb61b4-87cd-43e3-aa82-0eb35a33b35f', 'volume_name': 'volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be65a4af-04a1-493f-a1a5-375b43882dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be65a4af-04a1-493f-a1a5-375b43882dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d3cb61-8851-4195-9500-e0d89fde7871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:43 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume 91bb61b4-87cd-43e3-aa82-0eb35a33b35f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f', 'volume_size': 1} Jul 05 02:55:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:44 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423" returned: 0 in 0.654s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-412969142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e40664e-d2dc-4dce-99df-888feb95fad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:43Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Creating volume 3e40664e-d2dc-4dce-99df-888feb95fad9 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:55:44 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8439366-9acf-4d37-a1e8-81bf988bb18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786bf74d-cd98-419b-88d0-52ac18adb423', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:44 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9 1073741824 Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d200a6-5628-4f84-9e5b-8abc34e2cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:44 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:44 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume volume-786bf74d-cd98-419b-88d0-52ac18adb423 (786bf74d-cd98-419b-88d0-52ac18adb423): created successfully Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d200a6-5628-4f84-9e5b-8abc34e2cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (b45f37d9-3e40-4f01-8865-40ef9a92e997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-7cbfc1e3-9502-4f32-8629-2b876a35e02f tempest-CreateVolumesFromSnapshotTest-562585096 None] Created volume successfully. Jul 05 02:55:45 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9 1073741824" returned: 0 in 0.795s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:45 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9 Jul 05 02:55:45 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:45 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9" returned: 0 in 0.641s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.523s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-624127465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2065b195-3c54-457f-ab43-d2a69d860682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:43Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Creating volume 2065b195-3c54-457f-ab43-d2a69d860682 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:55:45 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:45 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682 1073741824 Jul 05 02:55:45 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef1dc32-bab1-49c8-8830-3851cf5a054b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e40664e-d2dc-4dce-99df-888feb95fad9', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b546f6-2ea9-4712-aab9-5850327e1bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:45 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume volume-3e40664e-d2dc-4dce-99df-888feb95fad9 (3e40664e-d2dc-4dce-99df-888feb95fad9): created successfully Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b546f6-2ea9-4712-aab9-5850327e1bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (b24a5173-cbdf-44d4-a696-b134aae863b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c82846e5-aa1b-492e-9e99-2bc71ad9e079 tempest-CreateVolumesFromSnapshotTest-562585096 None] Created volume successfully. Jul 05 02:55:46 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682 1073741824" returned: 0 in 0.812s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:46 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682 Jul 05 02:55:46 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:47 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682" returned: 0 in 0.662s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.656s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-438108067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b46af0-b1d9-488d-9cb6-9471a63fbde9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:43Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Creating volume c6b46af0-b1d9-488d-9cb6-9471a63fbde9 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:55:47 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39bd844-013a-4d76-8f72-130c418041a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2065b195-3c54-457f-ab43-d2a69d860682', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:47 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9 1073741824 Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e03b9d4-18ae-4186-87f7-d5db114229df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:47 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:47 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume volume-2065b195-3c54-457f-ab43-d2a69d860682 (2065b195-3c54-457f-ab43-d2a69d860682): created successfully Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e03b9d4-18ae-4186-87f7-d5db114229df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (0b51e305-9c12-4154-92ad-bab42c02abdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:47 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-93abe7e3-4d37-4b59-a330-063c6fd760a4 tempest-CreateVolumesFromSnapshotTest-562585096 None] Created volume successfully. Jul 05 02:55:48 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9 1073741824" returned: 0 in 0.802s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:48 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9 Jul 05 02:55:48 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:48 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9" returned: 0 in 0.630s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.804s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-573408725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91bb61b4-87cd-43e3-aa82-0eb35a33b35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9958d15ac5694fc79b4783fda2cb7ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:55:44Z,use_quota=True,user_id='a24aa8a3efa74073a89905b6840e034f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Creating volume 91bb61b4-87cd-43e3-aa82-0eb35a33b35f {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:55:48 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:48 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f 1073741824 Jul 05 02:55:48 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc696251-e776-493d-821a-cba66ea8848b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113fc93b-b12b-4465-b863-7fa05770ccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:48 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9 (c6b46af0-b1d9-488d-9cb6-9471a63fbde9): created successfully Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113fc93b-b12b-4465-b863-7fa05770ccfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (a99047b1-72b9-409b-a565-6b0e931061c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:48 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-880a73d9-7bbe-49f9-bc3f-c3d67f3b8d0e tempest-CreateVolumesFromSnapshotTest-562585096 None] Created volume successfully. Jul 05 02:55:49 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f 1073741824" returned: 0 in 0.783s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:49 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f Jul 05 02:55:49 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:50 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f" returned: 0 in 0.640s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d3cb61-8851-4195-9500-e0d89fde7871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b83899f-f96c-4b4e-be8c-01f3fbd25467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:55:50 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Volume volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f (91bb61b4-87cd-43e3-aa82-0eb35a33b35f): created successfully Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b83899f-f96c-4b4e-be8c-01f3fbd25467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Flow 'volume_create_manager' (1c86146e-6140-4c9c-a65f-633183ba94ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:55:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a3fd358b-9e24-44a7-851b-548904983813 tempest-CreateVolumesFromSnapshotTest-562585096 None] Created volume successfully. Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-91bb61b4-87cd-43e3-aa82-0eb35a33b35f-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-91bb61b4-87cd-43e3-aa82-0eb35a33b35f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-quobyte-91bb61b4-87cd-43e3-aa82-0eb35a33b35f" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-91bb61b4-87cd-43e3-aa82-0eb35a33b35f" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c875074-c9f4-4154-93b3-7f52918c0d42]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:50 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f Jul 05 02:55:50 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:51 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f" returned: 0 in 0.735s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:51 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f Jul 05 02:55:51 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:51 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-91bb61b4-87cd-43e3-aa82-0eb35a33b35f" returned: 0 in 0.644s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-91bb61b4-87cd-43e3-aa82-0eb35a33b35f" released by "delete_volume" :: held 1.417s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Created reservations ['0f385531-517d-4ca3-9d36-559582c155fe', '216d19e9-11d6-457d-a9cf-b79932e644b8', '32596840-1a3e-4c3f-81ea-4663218f85a8', '5a8e6d60-b9c1-4add-9a35-a50e6a6bed01'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:51 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:51 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-c6b46af0-b1d9-488d-9cb6-9471a63fbde9-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:52 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.630s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:52 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-c6b46af0-b1d9-488d-9cb6-9471a63fbde9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Deleted volume successfully. Jul 05 02:55:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-quobyte-c6b46af0-b1d9-488d-9cb6-9471a63fbde9" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-850736e3-4f83-4d40-99d3-589c320f859f tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-91bb61b4-87cd-43e3-aa82-0eb35a33b35f-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-c6b46af0-b1d9-488d-9cb6-9471a63fbde9" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:52 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39c8f53-83b0-4ce4-aa40-d5388e44d35e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:52 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9 Jul 05 02:55:52 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:53 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9" returned: 0 in 0.743s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:53 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9 Jul 05 02:55:53 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:54 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c6b46af0-b1d9-488d-9cb6-9471a63fbde9" returned: 0 in 0.637s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-c6b46af0-b1d9-488d-9cb6-9471a63fbde9" released by "delete_volume" :: held 1.417s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Created reservations ['e21a0f7e-ed5d-4e71-9d0f-4dc6dcb21308', '7ce0b191-f9a5-47f2-a89f-25ae17b48bc6', '3e7a1337-0a69-4f53-9fe6-b88377c14a74', 'f80adc34-cde1-42f2-b2ed-8639c508ee63'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:54 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:54 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-2065b195-3c54-457f-ab43-d2a69d860682-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:54 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-2065b195-3c54-457f-ab43-d2a69d860682-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.649s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:54 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Deleted volume successfully. Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4e151c17-e94c-42c2-8578-a9624d1e8675 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-c6b46af0-b1d9-488d-9cb6-9471a63fbde9-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-quobyte-2065b195-3c54-457f-ab43-d2a69d860682" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-2065b195-3c54-457f-ab43-d2a69d860682" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9276fe48-0ac5-4b30-a002-d0a0e7011fc5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:55 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682 Jul 05 02:55:55 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:55 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682" returned: 0 in 0.757s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:55 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682 Jul 05 02:55:55 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:56 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2065b195-3c54-457f-ab43-d2a69d860682" returned: 0 in 0.647s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-2065b195-3c54-457f-ab43-d2a69d860682" released by "delete_volume" :: held 1.440s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:56 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Created reservations ['972a37c4-272d-437c-81c6-189c1f001739', '3429307d-a2bc-4b70-817d-b445cf7307cd', '16528e98-c8b8-4f65-802d-8371d1cf0472', '3f6aca0d-972c-4331-b187-a06bd4e046a1'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:56 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:56 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-3e40664e-d2dc-4dce-99df-888feb95fad9-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-3e40664e-d2dc-4dce-99df-888feb95fad9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-quobyte-3e40664e-d2dc-4dce-99df-888feb95fad9" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:57 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.652s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Deleted volume successfully. Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-3e40664e-d2dc-4dce-99df-888feb95fad9" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-00d7910d-75a2-48b7-bf7f-1ffa44e1aa33 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-2065b195-3c54-457f-ab43-d2a69d860682-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c1688e-c2b7-45c5-9716-ab69723d469c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:57 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9 Jul 05 02:55:57 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:57 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9" returned: 0 in 0.738s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:57 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9 Jul 05 02:55:57 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:58 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-3e40664e-d2dc-4dce-99df-888feb95fad9" returned: 0 in 0.644s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:58 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-3e40664e-d2dc-4dce-99df-888feb95fad9" released by "delete_volume" :: held 1.428s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:58 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Created reservations ['c3d1c06d-1f38-4bfb-ac20-07a85d956ee6', '783cb69f-dbf7-4d7d-afe2-47f264b080e9', '87d39421-0e6e-41d7-8716-d33995337089', '1db94c5f-bc0f-4aa2-bec3-4cdbbbb1b02c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:55:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:55:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:55:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:55:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:55:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:55:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:58 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:55:58 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:55:59 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 05 02:55:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-786bf74d-cd98-419b-88d0-52ac18adb423-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.641s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:55:59 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:55:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Deleted volume successfully. Jul 05 02:55:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-786bf74d-cd98-419b-88d0-52ac18adb423-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b79fddac-cb46-4c7c-8b9c-5025cbfca8cd tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-3e40664e-d2dc-4dce-99df-888feb95fad9-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:55:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-quobyte-786bf74d-cd98-419b-88d0-52ac18adb423" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:55:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-786bf74d-cd98-419b-88d0-52ac18adb423" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:55:59 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6d0cef-c68b-4c8b-9e19-5664654356c4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:55:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:55:59 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423 Jul 05 02:55:59 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:00 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423" returned: 0 in 0.737s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:00 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423 Jul 05 02:56:00 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:00 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-786bf74d-cd98-419b-88d0-52ac18adb423" returned: 0 in 0.640s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-786bf74d-cd98-419b-88d0-52ac18adb423" released by "delete_volume" :: held 1.417s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Created reservations ['dae77fd5-8c0f-4697-9c24-f2861a77a656', 'e319c267-4a55-4b0e-9ffc-f5d2dcf7286e', '917b724f-a018-46c3-a13c-dae6f886716d', 'a28e9de2-ce49-423c-8fdb-2c45c3151384'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:00 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:56:00 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-b731c67d-34c0-4ac6-9b64-b7eabd465f41-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:01 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-b731c67d-34c0-4ac6-9b64-b7eabd465f41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-quobyte-c634c7ac-2681-4228-9611-e4b490e7ead7" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.639s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:56:01 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Deleted volume successfully. Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-c634c7ac-2681-4228-9611-e4b490e7ead7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-quobyte-b731c67d-34c0-4ac6-9b64-b7eabd465f41" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-b731c67d-34c0-4ac6-9b64-b7eabd465f41" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Deleting offline snapshot b731c67d-34c0-4ac6-9b64-b7eabd465f41 of volume c634c7ac-2681-4228-9611-e4b490e7ead7 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] snapshot_file for this snap is: volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c3191878-81fa-4621-85a1-fc7351788ee7 tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-786bf74d-cd98-419b-88d0-52ac18adb423-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac23c76-a227-4ada-a74e-8696b6f6919d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:01 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 Jul 05 02:56:01 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:02 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41" returned: 0 in 0.739s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c634c7ac-2681-4228-9611-e4b490e7ead7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:56:02 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe06d67-2d79-42dd-a06d-369a4958d489]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:02 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 Jul 05 02:56:02 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:03 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7" returned: 0 in 0.739s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:03 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 Jul 05 02:56:03 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:03 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41" returned: 0 in 0.706s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:03 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41 Jul 05 02:56:03 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:04 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7.b731c67d-34c0-4ac6-9b64-b7eabd465f41" returned: 0 in 0.634s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-b731c67d-34c0-4ac6-9b64-b7eabd465f41" released by "_delete_snapshot" :: held 2.918s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-c634c7ac-2681-4228-9611-e4b490e7ead7" released by "delete_snapshot" :: held 2.947s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Created reservations ['c7b20a2c-e335-4e93-b1f9-fa6be8b8702e', '2308e0d8-9a51-4070-aded-a1271c94e923', '1302cdc8-58be-4d36-8cc7-00311448f9a6', 'dcfe2620-4159-41e7-b09c-059176caa472'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:56:04 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Delete snapshot completed successfully. Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a7d1f1b5-f088-4287-911a-5622cd9410ef tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-b731c67d-34c0-4ac6-9b64-b7eabd465f41-delete_snapshot" released by "delete_snapshot" :: held 3.079s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-c634c7ac-2681-4228-9611-e4b490e7ead7-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-c634c7ac-2681-4228-9611-e4b490e7ead7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "cinder-quobyte-c634c7ac-2681-4228-9611-e4b490e7ead7" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-c634c7ac-2681-4228-9611-e4b490e7ead7" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7c319-c696-4948-afa9-0c8165414b67]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:04 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 Jul 05 02:56:04 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:05 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:56:05 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:05 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7" returned: 0 in 0.760s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:05 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7 Jul 05 02:56:05 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:05 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.645s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:56:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:56:06 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c634c7ac-2681-4228-9611-e4b490e7ead7" returned: 0 in 0.649s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-quobyte-c634c7ac-2681-4228-9611-e4b490e7ead7" released by "delete_volume" :: held 1.465s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=89,cinder:INSERT=30,cinder:UPDATE=137,cinder:DELETE=11 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=117,cinder:SELECT=83,cinder:DELETE=10,cinder:INSERT=31 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Created reservations ['0b8a234c-493c-4efb-84b0-0271f7ead33b', 'b9b51f29-383f-4dc1-9d2b-9e434351f789', 'eeaadf18-84ea-487c-a27e-84c4d790bb74', '043f07c0-3f0b-4a0b-b11a-fe6d310a996e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:06 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:56:06 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:06 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.656s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:56:06 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Deleted volume successfully. Jul 05 02:56:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de11d7dc-5d78-4743-ad1c-b98ccc98272a tempest-CreateVolumesFromSnapshotTest-562585096 None] Lock "cinder-c634c7ac-2681-4228-9611-e4b490e7ead7-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Flow 'volume_create_manager' (f747393d-1d9f-4b46-8403-178dbbd84550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df20d82-918f-4113-9a6f-45899fb46cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df20d82-918f-4113-9a6f-45899fb46cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-818881414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7739502-60e2-4509-a845-38eba655834c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac47078e638844028b89e258b0388311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:56:09Z,use_quota=True,user_id='5e0c6c0eaea444488f11b6ff6b9a53ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2601fe-6ff2-45cf-ac31-282ed6da9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2601fe-6ff2-45cf-ac31-282ed6da9141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decbb775-f798-43fc-a575-d2fc484339de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decbb775-f798-43fc-a575-d2fc484339de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7739502-60e2-4509-a845-38eba655834c', 'volume_name': 'volume-a7739502-60e2-4509-a845-38eba655834c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b0d756-058e-4bea-a49f-b688ca8504c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b0d756-058e-4bea-a49f-b688ca8504c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848b65ca-bb8a-4c03-9437-c07392df7db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:09 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Volume a7739502-60e2-4509-a845-38eba655834c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7739502-60e2-4509-a845-38eba655834c', 'volume_size': 1} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-818881414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7739502-60e2-4509-a845-38eba655834c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac47078e638844028b89e258b0388311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:56:09Z,use_quota=True,user_id='5e0c6c0eaea444488f11b6ff6b9a53ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Creating volume a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:56:09 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:56:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:09 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c 1073741824 Jul 05 02:56:09 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:10 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c 1073741824" returned: 0 in 0.788s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:10 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c Jul 05 02:56:10 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:11 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c" returned: 0 in 0.625s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848b65ca-bb8a-4c03-9437-c07392df7db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7739502-60e2-4509-a845-38eba655834c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6076ab23-5aca-4007-826f-db3b052d3817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Volume volume-a7739502-60e2-4509-a845-38eba655834c (a7739502-60e2-4509-a845-38eba655834c): created successfully Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6076ab23-5aca-4007-826f-db3b052d3817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Flow 'volume_create_manager' (f747393d-1d9f-4b46-8403-178dbbd84550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:56:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6739e479-269a-4360-a5f4-9621c4db3a77 tempest-VolumeDependencyTests-132244378 None] Created volume successfully. Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Creating offline snapshot 384eb786-8e96-4e11-98fd-239a0574790a of volume a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9d7379-e777-42fd-a837-b49b86d33449]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:11 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c Jul 05 02:56:11 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:12 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c" returned: 0 in 0.738s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:12 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a 1G Jul 05 02:56:12 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:13 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a 1G" returned: 0 in 0.762s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7739502-60e2-4509-a845-38eba655834c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:13 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7739502-60e2-4509-a845-38eba655834c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a Jul 05 02:56:13 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:13 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7739502-60e2-4509-a845-38eba655834c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a" returned: 0 in 0.667s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:13 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a is being set with open permissions: ugo+rw Jul 05 02:56:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:13 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a Jul 05 02:56:13 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:14 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a" returned: 0 in 0.630s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:14 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.info Jul 05 02:56:14 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:15 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.info" returned: 0 in 0.633s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:15 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.info is being set with open permissions: ugo+rw Jul 05 02:56:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:15 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.info Jul 05 02:56:15 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:15 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.info" returned: 0 in 0.635s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.145s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:15 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4359387d-287a-4d2d-9573-6ecafb46f94a tempest-VolumeDependencyTests-132244378 None] Create snapshot completed successfully Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Flow 'volume_create_manager' (fce9f5f3-027f-430e-9ba2-b8e406075753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1d092b-eca6-48b0-8e68-9f551adf1ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1d092b-eca6-48b0-8e68-9f551adf1ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1870213628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765d09cb-d217-4e31-965f-078c71ac279d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac47078e638844028b89e258b0388311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=384eb786-8e96-4e11-98fd-239a0574790a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:56:17Z,use_quota=True,user_id='5e0c6c0eaea444488f11b6ff6b9a53ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d6e663-2826-4465-b9ed-0559f3903e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d6e663-2826-4465-b9ed-0559f3903e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d74bc9-bf61-4e69-a3b7-3f5a70efddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d74bc9-bf61-4e69-a3b7-3f5a70efddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '765d09cb-d217-4e31-965f-078c71ac279d', 'volume_name': 'volume-765d09cb-d217-4e31-965f-078c71ac279d', 'volume_size': 1, 'snapshot_id': '384eb786-8e96-4e11-98fd-239a0574790a'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc51216-70f0-4b0e-826f-38fe75ce40da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc51216-70f0-4b0e-826f-38fe75ce40da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51e1a4d-1992-41d0-a5d1-76a3ad5354da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:17 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Volume 765d09cb-d217-4e31-965f-078c71ac279d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-765d09cb-d217-4e31-965f-078c71ac279d', 'volume_size': 1, 'snapshot_id': '384eb786-8e96-4e11-98fd-239a0574790a'} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Acquiring lock "cinder-quobyte-384eb786-8e96-4e11-98fd-239a0574790a-765d09cb-d217-4e31-965f-078c71ac279d" by "_create_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-384eb786-8e96-4e11-98fd-239a0574790a-765d09cb-d217-4e31-965f-078c71ac279d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Creating volume 765d09cb-d217-4e31-965f-078c71ac279d from snapshot 384eb786-8e96-4e11-98fd-239a0574790a {{(pid=86671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Acquiring lock "cinder-quobyte-765d09cb-d217-4e31-965f-078c71ac279d" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-765d09cb-d217-4e31-965f-078c71ac279d" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] snapshot: 384eb786-8e96-4e11-98fd-239a0574790a, volume: 765d09cb-d217-4e31-965f-078c71ac279d, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab9843c-2326-4f6d-9d70-3afeeb08dd0f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:17 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a Jul 05 02:56:17 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:18 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a" returned: 0 in 0.759s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7739502-60e2-4509-a845-38eba655834c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:56:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:56:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:56:18 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[300d48ee-34c5-4dfe-9d16-7e3302bd9da1]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:18 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c Jul 05 02:56:18 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:19 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c" returned: 0 in 0.754s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:19 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:56:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:19 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d Jul 05 02:56:19 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:23 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d" returned: 0 in 4.351s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:23 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bb68be-f294-44e3-93d0-81d4a953afde]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:23 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c Jul 05 02:56:23 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:24 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c" returned: 0 in 0.904s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:24 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c, size 1024.00 MB, duration 4.35 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:56:24 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Converted 1024.00 MB image at 235.26 MB/s Jul 05 02:56:24 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d is being set with open permissions: ugo+rw Jul 05 02:56:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:24 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d Jul 05 02:56:24 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:25 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d" returned: 0 in 0.633s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-765d09cb-d217-4e31-965f-078c71ac279d" released by "_copy_volume_from_snapshot" :: held 7.485s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-384eb786-8e96-4e11-98fd-239a0574790a-765d09cb-d217-4e31-965f-078c71ac279d" released by "_create_volume_from_snapshot" :: held 7.512s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.525s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51e1a4d-1992-41d0-a5d1-76a3ad5354da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765d09cb-d217-4e31-965f-078c71ac279d', 'volume_size': 1, 'snapshot_id': '384eb786-8e96-4e11-98fd-239a0574790a'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77df4b09-7cb6-4316-99b4-ef85653f6935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:25 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Volume volume-765d09cb-d217-4e31-965f-078c71ac279d (765d09cb-d217-4e31-965f-078c71ac279d): created successfully Jul 05 02:56:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77df4b09-7cb6-4316-99b4-ef85653f6935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Flow 'volume_create_manager' (fce9f5f3-027f-430e-9ba2-b8e406075753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:56:25 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-eb59d6ac-af95-4b7f-8dde-f636821a4a4b tempest-VolumeDependencyTests-132244378 None] Created volume successfully. Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "cinder-384eb786-8e96-4e11-98fd-239a0574790a-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-384eb786-8e96-4e11-98fd-239a0574790a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "cinder-quobyte-a7739502-60e2-4509-a845-38eba655834c" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-a7739502-60e2-4509-a845-38eba655834c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "cinder-quobyte-384eb786-8e96-4e11-98fd-239a0574790a" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-384eb786-8e96-4e11-98fd-239a0574790a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Deleting offline snapshot 384eb786-8e96-4e11-98fd-239a0574790a of volume a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] snapshot_file for this snap is: volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[087c510e-32e7-441b-b151-bbae27b8a022]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:26 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a Jul 05 02:56:26 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:26 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a" returned: 0 in 0.730s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7739502-60e2-4509-a845-38eba655834c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[65af8e4c-83b7-48ff-bdfd-44199f22bd46]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:27 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c Jul 05 02:56:27 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:27 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c" returned: 0 in 0.728s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:27 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a Jul 05 02:56:27 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:28 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a" returned: 0 in 0.711s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:28 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a Jul 05 02:56:28 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:29 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c.384eb786-8e96-4e11-98fd-239a0574790a" returned: 0 in 0.638s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-384eb786-8e96-4e11-98fd-239a0574790a" released by "_delete_snapshot" :: held 2.902s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-a7739502-60e2-4509-a845-38eba655834c" released by "delete_snapshot" :: held 2.930s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Created reservations ['1ddc99e5-9851-4198-bb46-f108ff27cf71', '6a763fc8-9619-4b3a-8d5d-e744da58e2b5', '4014cada-ab7a-4394-a0a2-86e71fd08698', '4ed94761-4143-40c7-a240-817e29e190ab'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:56:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Delete snapshot completed successfully. Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5098f75e-a07d-4db5-9849-bf3f54f51984 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-384eb786-8e96-4e11-98fd-239a0574790a-delete_snapshot" released by "delete_snapshot" :: held 3.051s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "cinder-a7739502-60e2-4509-a845-38eba655834c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-a7739502-60e2-4509-a845-38eba655834c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "cinder-quobyte-a7739502-60e2-4509-a845-38eba655834c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-a7739502-60e2-4509-a845-38eba655834c" acquired by "delete_volume" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ace6c69-5251-4ea8-8e9e-493a557b021f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:29 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c Jul 05 02:56:29 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:30 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c" returned: 0 in 0.742s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:30 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c Jul 05 02:56:30 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:30 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a7739502-60e2-4509-a845-38eba655834c" returned: 0 in 0.631s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-a7739502-60e2-4509-a845-38eba655834c" released by "delete_volume" :: held 1.429s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Created reservations ['efbbff51-e696-4510-9c57-15f925e656f6', '4d1926cb-777f-4562-b05c-0379e7e1b0a3', '4e6e4dee-449a-4122-ad42-ee8d3e5064b1', 'f09a52fc-5684-4b5f-a345-d665d7b5f033'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:30 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:56:30 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "cinder-765d09cb-d217-4e31-965f-078c71ac279d-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:31 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.634s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:31 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:56:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Deleted volume successfully. Jul 05 02:56:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-765d09cb-d217-4e31-965f-078c71ac279d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6f405751-86f0-4beb-8062-313cc48edc83 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-a7739502-60e2-4509-a845-38eba655834c-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "cinder-quobyte-765d09cb-d217-4e31-965f-078c71ac279d" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-765d09cb-d217-4e31-965f-078c71ac279d" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ade807-f790-4048-bde3-d13a877bb5c9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:31 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d Jul 05 02:56:31 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:32 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d" returned: 0 in 0.758s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:32 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d Jul 05 02:56:32 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:33 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-765d09cb-d217-4e31-965f-078c71ac279d" returned: 0 in 0.640s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-quobyte-765d09cb-d217-4e31-965f-078c71ac279d" released by "delete_volume" :: held 1.437s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Created reservations ['275847a5-65f5-4ae0-8271-9fa93e54df52', 'c2c572fb-d462-43ba-9ecc-70e583047413', '6f32b93a-09d3-4208-8ef3-55509af1eb7b', 'b25f0d53-693f-4a66-8259-4456ee44c06e'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:33 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:56:33 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:33 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.644s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:56:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Deleted volume successfully. Jul 05 02:56:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-683a9adb-e736-4279-8f39-d1cf83e35f00 tempest-VolumeDependencyTests-132244378 None] Lock "cinder-765d09cb-d217-4e31-965f-078c71ac279d-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Flow 'volume_create_manager' (2fc5c530-d73e-4ecf-8877-f003128ddcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca625c91-c111-48d5-8244-3b7affe5582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca625c91-c111-48d5-8244-3b7affe5582c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b14cbc9-606e-4038-89e6-e59d8965d863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4027b757a0f6476fab68d2ee9c12bd83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:56:36Z,use_quota=True,user_id='0bcc0dc92e0b4bc18463e6ae31388a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4098768-a7a7-4bfc-a61e-f275f6342d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4098768-a7a7-4bfc-a61e-f275f6342d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5679eb00-185b-4483-8715-67d67e856e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5679eb00-185b-4483-8715-67d67e856e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b14cbc9-606e-4038-89e6-e59d8965d863', 'volume_name': 'volume-1b14cbc9-606e-4038-89e6-e59d8965d863', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbc7d0c-e443-487b-8d7b-05b0b79f155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbc7d0c-e443-487b-8d7b-05b0b79f155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b83ded-4416-4cdd-b2eb-7dc74bf19312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:36 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Volume 1b14cbc9-606e-4038-89e6-e59d8965d863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b14cbc9-606e-4038-89e6-e59d8965d863', 'volume_size': 1} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b14cbc9-606e-4038-89e6-e59d8965d863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4027b757a0f6476fab68d2ee9c12bd83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:56:36Z,use_quota=True,user_id='0bcc0dc92e0b4bc18463e6ae31388a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Creating volume 1b14cbc9-606e-4038-89e6-e59d8965d863 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:56:36 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:56:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:36 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863 1073741824 Jul 05 02:56:36 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:37 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863 1073741824" returned: 0 in 0.805s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:37 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863 Jul 05 02:56:37 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:37 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863" returned: 0 in 0.650s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:56:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b83ded-4416-4cdd-b2eb-7dc74bf19312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b14cbc9-606e-4038-89e6-e59d8965d863', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b928c56f-84f2-43f4-828c-eb63cbb74277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:38 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Volume volume-1b14cbc9-606e-4038-89e6-e59d8965d863 (1b14cbc9-606e-4038-89e6-e59d8965d863): created successfully Jul 05 02:56:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b928c56f-84f2-43f4-828c-eb63cbb74277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Flow 'volume_create_manager' (2fc5c530-d73e-4ecf-8877-f003128ddcee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:56:38 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-13c7ad41-bb6a-4466-aa3f-f9dd1188ed0a tempest-CinderUnicodeTest-818666909 None] Created volume successfully. Jul 05 02:56:38 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:56:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Flow 'volume_create_manager' (06de5d09-cd3c-4a8a-a7f0-70c6cd2306a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:56:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30872a0c-965a-4976-9558-12ae8d63d832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30872a0c-965a-4976-9558-12ae8d63d832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:56:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2022553500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f139d76-29f7-4879-a8be-2f0cca43513c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4027b757a0f6476fab68d2ee9c12bd83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:56:39Z,use_quota=True,user_id='0bcc0dc92e0b4bc18463e6ae31388a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4988c0-4ae7-4701-a73b-cb4c3efca75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4988c0-4ae7-4701-a73b-cb4c3efca75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408f6340-0c17-4348-95b1-ca035ad57b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408f6340-0c17-4348-95b1-ca035ad57b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f139d76-29f7-4879-a8be-2f0cca43513c', 'volume_name': 'volume-8f139d76-29f7-4879-a8be-2f0cca43513c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48817153-7701-4d97-90d2-92c8077d2882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48817153-7701-4d97-90d2-92c8077d2882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc02d2ee-5e4f-4f4a-886b-babcdaa41d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:39 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Volume 8f139d76-29f7-4879-a8be-2f0cca43513c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f139d76-29f7-4879-a8be-2f0cca43513c', 'volume_size': 1} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:56:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2022553500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f139d76-29f7-4879-a8be-2f0cca43513c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4027b757a0f6476fab68d2ee9c12bd83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:56:39Z,use_quota=True,user_id='0bcc0dc92e0b4bc18463e6ae31388a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Creating volume 8f139d76-29f7-4879-a8be-2f0cca43513c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:56:39 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:39 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c 1073741824 Jul 05 02:56:39 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:39 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c 1073741824" returned: 0 in 0.796s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:39 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c Jul 05 02:56:39 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:40 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c" returned: 0 in 0.633s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:56:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc02d2ee-5e4f-4f4a-886b-babcdaa41d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f139d76-29f7-4879-a8be-2f0cca43513c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab15ca0-246a-442f-8157-9e84a81d7b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:40 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Volume volume-8f139d76-29f7-4879-a8be-2f0cca43513c (8f139d76-29f7-4879-a8be-2f0cca43513c): created successfully Jul 05 02:56:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab15ca0-246a-442f-8157-9e84a81d7b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Flow 'volume_create_manager' (06de5d09-cd3c-4a8a-a7f0-70c6cd2306a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:56:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1f4826de-fc81-4d29-b6bd-092c3d227969 tempest-CinderUnicodeTest-818666909 None] Created volume successfully. Jul 05 02:56:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Creating offline snapshot ad9316a3-d6e4-49ad-9706-c773d68f7e01 of volume 8f139d76-29f7-4879-a8be-2f0cca43513c {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:56:41 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa9ec62-be1b-4205-aaf5-e1ab24c216cf]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:41 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c Jul 05 02:56:41 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:41 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c" returned: 0 in 0.735s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:42 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 1G Jul 05 02:56:42 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:42 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 1G" returned: 0 in 0.781s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f139d76-29f7-4879-a8be-2f0cca43513c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:42 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f139d76-29f7-4879-a8be-2f0cca43513c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 Jul 05 02:56:42 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:43 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f139d76-29f7-4879-a8be-2f0cca43513c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01" returned: 0 in 0.674s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:43 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 is being set with open permissions: ugo+rw Jul 05 02:56:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:43 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 Jul 05 02:56:43 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:44 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01" returned: 0 in 0.634s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:44 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.info Jul 05 02:56:44 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:44 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.info" returned: 0 in 0.655s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:44 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.info is being set with open permissions: ugo+rw Jul 05 02:56:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:44 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.info Jul 05 02:56:44 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:45 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.info" returned: 0 in 0.634s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.199s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-12eee47f-aae1-4c61-99c1-3d45fe64eb0e tempest-CinderUnicodeTest-818666909 None] Create snapshot completed successfully Jul 05 02:56:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "cinder-ad9316a3-d6e4-49ad-9706-c773d68f7e01-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-ad9316a3-d6e4-49ad-9706-c773d68f7e01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "cinder-quobyte-8f139d76-29f7-4879-a8be-2f0cca43513c" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-quobyte-8f139d76-29f7-4879-a8be-2f0cca43513c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "cinder-quobyte-ad9316a3-d6e4-49ad-9706-c773d68f7e01" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-quobyte-ad9316a3-d6e4-49ad-9706-c773d68f7e01" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Deleting offline snapshot ad9316a3-d6e4-49ad-9706-c773d68f7e01 of volume 8f139d76-29f7-4879-a8be-2f0cca43513c {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:56:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] snapshot_file for this snap is: volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:56:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b7b9be-b3e5-4fb4-9202-35c746b6c51b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:46 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 Jul 05 02:56:46 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:47 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01" returned: 0 in 0.748s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f139d76-29f7-4879-a8be-2f0cca43513c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:56:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[253fa4c1-1713-4b88-a7c0-3d7410a99b7f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:47 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c Jul 05 02:56:47 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:48 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c" returned: 0 in 0.737s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:48 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 Jul 05 02:56:48 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:48 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01" returned: 0 in 0.714s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:48 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01 Jul 05 02:56:48 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:49 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c.ad9316a3-d6e4-49ad-9706-c773d68f7e01" returned: 0 in 0.639s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-quobyte-ad9316a3-d6e4-49ad-9706-c773d68f7e01" released by "_delete_snapshot" :: held 2.933s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-quobyte-8f139d76-29f7-4879-a8be-2f0cca43513c" released by "delete_snapshot" :: held 2.953s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Created reservations ['ed2a57d7-0bb4-40e3-b63f-45d840b477f2', '7921ef27-c4ef-4c43-98d4-7736d8bf7c4c', '06495f8e-ad3d-47e1-9793-34af6cab4a9b', '2b3e5165-d865-407a-946d-09b57156c220'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:56:49 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Delete snapshot completed successfully. Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-935d5f0b-826f-4145-87fb-872b5c2f8115 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-ad9316a3-d6e4-49ad-9706-c773d68f7e01-delete_snapshot" released by "delete_snapshot" :: held 3.079s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "cinder-8f139d76-29f7-4879-a8be-2f0cca43513c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-8f139d76-29f7-4879-a8be-2f0cca43513c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "cinder-quobyte-8f139d76-29f7-4879-a8be-2f0cca43513c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-quobyte-8f139d76-29f7-4879-a8be-2f0cca43513c" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dcf279-d735-4679-90b6-e2b2c7d3e0fb]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:49 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c Jul 05 02:56:49 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:50 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c" returned: 0 in 0.735s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:50 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c Jul 05 02:56:50 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:51 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f139d76-29f7-4879-a8be-2f0cca43513c" returned: 0 in 0.632s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-quobyte-8f139d76-29f7-4879-a8be-2f0cca43513c" released by "delete_volume" :: held 1.425s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Created reservations ['ee0b93c1-690c-4587-9f65-081f7154d721', 'ce862b56-e63c-40c4-9464-259e682cd110', '50189f61-471f-4d62-b011-15ce997a4b96', 'a55f0953-5471-4666-b423-8e464c35d61a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:51 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:56:51 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "cinder-1b14cbc9-606e-4038-89e6-e59d8965d863-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:51 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.651s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-1b14cbc9-606e-4038-89e6-e59d8965d863-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:51 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Deleted volume successfully. Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6b2b728e-cb33-49f7-a80e-5a0923d0f408 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-8f139d76-29f7-4879-a8be-2f0cca43513c-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "cinder-quobyte-1b14cbc9-606e-4038-89e6-e59d8965d863" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-quobyte-1b14cbc9-606e-4038-89e6-e59d8965d863" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fde0442-4cc8-4aca-a54a-6970eae01219]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:52 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863 Jul 05 02:56:52 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:52 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863" returned: 0 in 0.765s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:52 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863 Jul 05 02:56:52 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:53 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1b14cbc9-606e-4038-89e6-e59d8965d863" returned: 0 in 0.635s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:53 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-quobyte-1b14cbc9-606e-4038-89e6-e59d8965d863" released by "delete_volume" :: held 1.440s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:53 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Created reservations ['d2769031-3170-4a73-8b56-afbc697df236', 'cf3208ee-d51d-4bd6-bf08-e5d93f5db265', '461f41d0-3250-4b05-bd09-efcc1a868d29', '5a8cd414-66da-4235-8cd0-48ecb4df501f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:56:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:53 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:53 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:56:53 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:54 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.627s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:54 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:56:54 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Deleted volume successfully. Jul 05 02:56:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-be698446-8da5-423d-8b62-db50d5dd0dc4 tempest-CinderUnicodeTest-818666909 None] Lock "cinder-1b14cbc9-606e-4038-89e6-e59d8965d863-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Flow 'volume_create_manager' (099239be-bea6-41cf-a30e-d389e02f0e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9d63c8-0d7e-4fc6-a168-7e92964af3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9d63c8-0d7e-4fc6-a168-7e92964af3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576468701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9002e53f-0eac-475f-b417-8c5e9d2a1c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79e43f215384850ad8c8785c08651fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:56:57Z,use_quota=True,user_id='512cdb67f18447519fc9d0c8a64d4fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afbf57a-175b-4e8e-a205-7453fbb99fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afbf57a-175b-4e8e-a205-7453fbb99fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918da901-a619-4583-9796-4f177c7d89ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918da901-a619-4583-9796-4f177c7d89ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9002e53f-0eac-475f-b417-8c5e9d2a1c27', 'volume_name': 'volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b729720-845d-476b-9d47-3b1f47041f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b729720-845d-476b-9d47-3b1f47041f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86db9f0-cdb8-4e2f-9e86-55edf04b00d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:57 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Volume 9002e53f-0eac-475f-b417-8c5e9d2a1c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27', 'volume_size': 1} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576468701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9002e53f-0eac-475f-b417-8c5e9d2a1c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79e43f215384850ad8c8785c08651fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:56:57Z,use_quota=True,user_id='512cdb67f18447519fc9d0c8a64d4fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Creating volume 9002e53f-0eac-475f-b417-8c5e9d2a1c27 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:56:57 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:56:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:57 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27 1073741824 Jul 05 02:56:57 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:58 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27 1073741824" returned: 0 in 0.825s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:58 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27 Jul 05 02:56:58 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:56:58 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 05 02:56:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27" returned: 0 in 0.642s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:56:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:56:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:56:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86db9f0-cdb8-4e2f-9e86-55edf04b00d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0777ff6c-d9ac-4538-8890-645f0bbfcd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:56:58 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Volume volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27 (9002e53f-0eac-475f-b417-8c5e9d2a1c27): created successfully Jul 05 02:56:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0777ff6c-d9ac-4538-8890-645f0bbfcd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:56:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Flow 'volume_create_manager' (099239be-bea6-41cf-a30e-d389e02f0e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:56:58 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2211115a-3157-4bdd-987f-ec613f4d69e0 tempest-ProjectReaderTests-2034142550 None] Created volume successfully. Jul 05 02:56:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "cinder-9002e53f-0eac-475f-b417-8c5e9d2a1c27-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-9002e53f-0eac-475f-b417-8c5e9d2a1c27-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "cinder-quobyte-9002e53f-0eac-475f-b417-8c5e9d2a1c27" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:56:59 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-quobyte-9002e53f-0eac-475f-b417-8c5e9d2a1c27" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:56:59 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc53d58-b1c5-4e87-b577-da83c8148f26]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:56:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:56:59 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27 Jul 05 02:56:59 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:00 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27" returned: 0 in 0.741s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:00 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27 Jul 05 02:57:00 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:00 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9002e53f-0eac-475f-b417-8c5e9d2a1c27" returned: 0 in 0.643s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-quobyte-9002e53f-0eac-475f-b417-8c5e9d2a1c27" released by "delete_volume" :: held 1.427s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:00 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Created reservations ['7fddf34a-97bc-4392-aaa8-96018e095f09', '9c4aa288-d07c-42c5-bd51-26b909ceadb2', '9a9b0fc2-e474-4443-b70e-b5df9db94119', '0bc1f487-d24c-43b6-a8cd-5f59bc36a1a8'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:57:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:01 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:01 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:01 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:01 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.638s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:01 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:01 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Deleted volume successfully. Jul 05 02:57:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0a164be2-d333-4772-8d3a-6c1459a505d1 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-9002e53f-0eac-475f-b417-8c5e9d2a1c27-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Flow 'volume_create_manager' (c90b392d-b592-4f09-a2f5-026cee187761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529c164e-122d-47b6-98cb-5d83a89317b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529c164e-122d-47b6-98cb-5d83a89317b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597388666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03383457-59e5-4980-8fcb-2f20cee63d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79e43f215384850ad8c8785c08651fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:02Z,use_quota=True,user_id='512cdb67f18447519fc9d0c8a64d4fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a982449-6524-48b4-91e9-9a38dfc81d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a982449-6524-48b4-91e9-9a38dfc81d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf90cab-a159-4e0b-9de4-6d1ae2757d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf90cab-a159-4e0b-9de4-6d1ae2757d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03383457-59e5-4980-8fcb-2f20cee63d9a', 'volume_name': 'volume-03383457-59e5-4980-8fcb-2f20cee63d9a', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368260c9-7d04-4bc0-867f-9e83adafe864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368260c9-7d04-4bc0-867f-9e83adafe864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d162b88d-b33e-4661-9bd5-34b975ae0a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:02 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Volume 03383457-59e5-4980-8fcb-2f20cee63d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03383457-59e5-4980-8fcb-2f20cee63d9a', 'volume_size': 1} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597388666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03383457-59e5-4980-8fcb-2f20cee63d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79e43f215384850ad8c8785c08651fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:02Z,use_quota=True,user_id='512cdb67f18447519fc9d0c8a64d4fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Creating volume 03383457-59e5-4980-8fcb-2f20cee63d9a {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:02 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:02 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a 1073741824 Jul 05 02:57:02 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:02 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a 1073741824" returned: 0 in 0.802s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:03 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a Jul 05 02:57:03 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:03 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a" returned: 0 in 0.638s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d162b88d-b33e-4661-9bd5-34b975ae0a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03383457-59e5-4980-8fcb-2f20cee63d9a', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12253eca-cfe2-4b08-a8dc-74790ce92111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:03 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Volume volume-03383457-59e5-4980-8fcb-2f20cee63d9a (03383457-59e5-4980-8fcb-2f20cee63d9a): created successfully Jul 05 02:57:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12253eca-cfe2-4b08-a8dc-74790ce92111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Flow 'volume_create_manager' (c90b392d-b592-4f09-a2f5-026cee187761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1385a4e6-c667-4ddf-9dab-217045189e2b tempest-ProjectReaderTests-2034142550 None] Created volume successfully. Jul 05 02:57:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Acquiring lock "cinder-03383457-59e5-4980-8fcb-2f20cee63d9a-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Lock "cinder-03383457-59e5-4980-8fcb-2f20cee63d9a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Acquiring lock "cinder-quobyte-03383457-59e5-4980-8fcb-2f20cee63d9a" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Lock "cinder-quobyte-03383457-59e5-4980-8fcb-2f20cee63d9a" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda0a15a-6afd-4bbf-a22a-2be4aecac63d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:04 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a Jul 05 02:57:04 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:05 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a" returned: 0 in 0.747s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:05 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a Jul 05 02:57:05 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:05 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:05 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:05 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-03383457-59e5-4980-8fcb-2f20cee63d9a" returned: 0 in 0.660s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Lock "cinder-quobyte-03383457-59e5-4980-8fcb-2f20cee63d9a" released by "delete_volume" :: held 1.450s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Created reservations ['66427dba-4322-4089-8dfb-4c6e34023238', '8a6916de-33f5-4d77-9b48-18af0f94d974', 'd4248b47-0b49-4e0a-a82e-2e15d1355b80', 'b9ee543f-b18a-43cd-b218-e614b4df6b90'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:05 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:05 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:05 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.650s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:57:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:57:06 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.643s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:06 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Deleted volume successfully. Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=66,cinder:INSERT=22,cinder:UPDATE=79,cinder:DELETE=7 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-06809f0c-f9c5-4150-b6a0-b1a84b67fdcf tempest-ProjectReaderTests-2034142550 None] Lock "cinder-03383457-59e5-4980-8fcb-2f20cee63d9a-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=95,cinder:SELECT=63,cinder:DELETE=8,cinder:INSERT=21 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Flow 'volume_create_manager' (ad0f22cc-7bd3-488d-b81b-dc753fec237e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8619d9-5764-4ec8-afd2-9c440dd083a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8619d9-5764-4ec8-afd2-9c440dd083a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123097357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d563b1-73db-4ccb-a873-b1f1c6339fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79e43f215384850ad8c8785c08651fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:07Z,use_quota=True,user_id='512cdb67f18447519fc9d0c8a64d4fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3768b1ac-2590-4791-86a6-dc898d96a02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3768b1ac-2590-4791-86a6-dc898d96a02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a1ad4e-b653-4266-b118-4310f64868c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a1ad4e-b653-4266-b118-4310f64868c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d563b1-73db-4ccb-a873-b1f1c6339fe2', 'volume_name': 'volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9dbe63-267a-4898-9848-42c7a760d0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9dbe63-267a-4898-9848-42c7a760d0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370c865f-6b74-4a23-94ac-a5a10eeb065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:06 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Volume 95d563b1-73db-4ccb-a873-b1f1c6339fe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2', 'volume_size': 1} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123097357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d563b1-73db-4ccb-a873-b1f1c6339fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79e43f215384850ad8c8785c08651fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:07Z,use_quota=True,user_id='512cdb67f18447519fc9d0c8a64d4fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Creating volume 95d563b1-73db-4ccb-a873-b1f1c6339fe2 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:06 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:06 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2 1073741824 Jul 05 02:57:06 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:07 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2 1073741824" returned: 0 in 0.796s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:07 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2 Jul 05 02:57:07 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:08 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2" returned: 0 in 0.638s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370c865f-6b74-4a23-94ac-a5a10eeb065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d858bd-34de-4393-8f19-46ab39d8b47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:08 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Volume volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2 (95d563b1-73db-4ccb-a873-b1f1c6339fe2): created successfully Jul 05 02:57:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d858bd-34de-4393-8f19-46ab39d8b47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:08 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Flow 'volume_create_manager' (ad0f22cc-7bd3-488d-b81b-dc753fec237e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:08 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2f26cc6f-5999-4c48-ad0d-638b0c8043bf tempest-ProjectReaderTests-2034142550 None] Created volume successfully. Jul 05 02:57:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "cinder-95d563b1-73db-4ccb-a873-b1f1c6339fe2-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-95d563b1-73db-4ccb-a873-b1f1c6339fe2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "cinder-quobyte-95d563b1-73db-4ccb-a873-b1f1c6339fe2" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-quobyte-95d563b1-73db-4ccb-a873-b1f1c6339fe2" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:09 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d4b8eb-523f-44cc-b559-d9098c5cb8f2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:09 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2 Jul 05 02:57:09 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:09 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2" returned: 0 in 0.743s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:09 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2 Jul 05 02:57:09 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:10 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-95d563b1-73db-4ccb-a873-b1f1c6339fe2" returned: 0 in 0.658s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-quobyte-95d563b1-73db-4ccb-a873-b1f1c6339fe2" released by "delete_volume" :: held 1.446s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:10 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Created reservations ['6881a878-590c-445b-9295-19234f1b2a6f', '850d99ad-fa0d-4f16-8e7f-fb12da43bfcb', 'b7d2e199-2454-4da8-9ffe-d7c400c2bd3a', 'fee37d59-b10f-4a10-bdda-fd0183e60878'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:57:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:10 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:10 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:11 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.647s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Deleted volume successfully. Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-056ca050-4abf-44e6-99e3-bdb89c293403 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-95d563b1-73db-4ccb-a873-b1f1c6339fe2-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Flow 'volume_create_manager' (3966df58-1849-435c-b8f7-2db6b13970d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6189694a-b4b0-4454-94f8-827e3f56ecef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6189694a-b4b0-4454-94f8-827e3f56ecef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603386304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bffdced-e473-4254-9177-71c8d67e8c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79e43f215384850ad8c8785c08651fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:12Z,use_quota=True,user_id='512cdb67f18447519fc9d0c8a64d4fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d131df6-59f8-4a3b-800b-e53e69fe3fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d131df6-59f8-4a3b-800b-e53e69fe3fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2648cc2-59cc-4fde-a113-e22b02b8a1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2648cc2-59cc-4fde-a113-e22b02b8a1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bffdced-e473-4254-9177-71c8d67e8c6c', 'volume_name': 'volume-7bffdced-e473-4254-9177-71c8d67e8c6c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c37237-645e-4fda-9f78-105078f552c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c37237-645e-4fda-9f78-105078f552c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195657c7-5685-479f-84b7-92c8973ac3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Volume 7bffdced-e473-4254-9177-71c8d67e8c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bffdced-e473-4254-9177-71c8d67e8c6c', 'volume_size': 1} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603386304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bffdced-e473-4254-9177-71c8d67e8c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79e43f215384850ad8c8785c08651fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:12Z,use_quota=True,user_id='512cdb67f18447519fc9d0c8a64d4fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Creating volume 7bffdced-e473-4254-9177-71c8d67e8c6c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:11 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:11 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c 1073741824 Jul 05 02:57:11 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:12 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c 1073741824" returned: 0 in 0.818s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:12 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c Jul 05 02:57:12 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:13 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c" returned: 0 in 0.636s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195657c7-5685-479f-84b7-92c8973ac3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bffdced-e473-4254-9177-71c8d67e8c6c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8c651d-08eb-48ba-9b51-c3202a77a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:13 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Volume volume-7bffdced-e473-4254-9177-71c8d67e8c6c (7bffdced-e473-4254-9177-71c8d67e8c6c): created successfully Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8c651d-08eb-48ba-9b51-c3202a77a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Flow 'volume_create_manager' (3966df58-1849-435c-b8f7-2db6b13970d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8306f49f-3531-4201-acdd-b3ae20d2b362 tempest-ProjectReaderTests-2034142550 None] Created volume successfully. Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "cinder-7bffdced-e473-4254-9177-71c8d67e8c6c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-7bffdced-e473-4254-9177-71c8d67e8c6c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "cinder-quobyte-7bffdced-e473-4254-9177-71c8d67e8c6c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-quobyte-7bffdced-e473-4254-9177-71c8d67e8c6c" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bdb101-d77b-4bd3-a281-db1940395e2f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:13 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c Jul 05 02:57:13 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:14 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c" returned: 0 in 0.738s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:14 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c Jul 05 02:57:14 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:15 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7bffdced-e473-4254-9177-71c8d67e8c6c" returned: 0 in 0.631s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-quobyte-7bffdced-e473-4254-9177-71c8d67e8c6c" released by "delete_volume" :: held 1.408s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Created reservations ['6ccbd5bd-e777-4258-afec-3b0adb15ba54', '19aeceb5-cfa5-46d2-b5c9-c839a9c6048b', '740ba348-7a75-4b06-8559-e4236ed9cb6b', 'cb3dd493-60a4-460b-a9d7-ef322ebd0e09'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:15 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:15 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:15 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.621s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:15 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Deleted volume successfully. Jul 05 02:57:15 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-eb72f4b8-40c0-4af8-beee-45fc82f16306 tempest-ProjectReaderTests-2034142550 None] Lock "cinder-7bffdced-e473-4254-9177-71c8d67e8c6c-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:25 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=20,cinder:SELECT=14,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:57:25 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=13,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (5c576512-d841-4de7-b466-6c219f72de85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09bfbf4-91bc-454b-97f5-d97ac3feb6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09bfbf4-91bc-454b-97f5-d97ac3feb6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-814933192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81fb7b8-62e4-47f4-81e4-c6c11b349e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:28Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3649317-7c9b-4cb8-86ee-b28a2e8b49af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3649317-7c9b-4cb8-86ee-b28a2e8b49af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b31df1-fa0d-4f9f-89ea-190104634540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b31df1-fa0d-4f9f-89ea-190104634540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b81fb7b8-62e4-47f4-81e4-c6c11b349e53', 'volume_name': 'volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1652fb6d-a08a-42f4-898f-b1bf47630d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1652fb6d-a08a-42f4-898f-b1bf47630d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335dac66-e579-4d2f-86e8-d929aef65ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume b81fb7b8-62e4-47f4-81e4-c6c11b349e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53', 'volume_size': 1} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-814933192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81fb7b8-62e4-47f4-81e4-c6c11b349e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:28Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Creating volume b81fb7b8-62e4-47f4-81e4-c6c11b349e53 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:28 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:28 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 1073741824 Jul 05 02:57:28 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Flow 'volume_create_manager' (15abf4db-dc54-4bec-bc5c-900d8c96f978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18e7185-bf8a-4f0a-a57a-296351eb100d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18e7185-bf8a-4f0a-a57a-296351eb100d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1742521988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283091bc1054c88a1751fc2f8ebfd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:28Z,use_quota=True,user_id='c2912f8749234bd7984faa42d83907ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8139136c-d167-4fd4-a958-c3498c8fcf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8139136c-d167-4fd4-a958-c3498c8fcf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2d50f9-b509-4227-bb4b-b2639ed2a8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2d50f9-b509-4227-bb4b-b2639ed2a8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8', 'volume_name': 'volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe600a81-1cb6-4bd7-988b-4a3c797ffebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe600a81-1cb6-4bd7-988b-4a3c797ffebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef8e082-622c-45b7-b81d-1e4ee94aba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Volume bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8', 'volume_size': 1} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Flow 'volume_create_manager' (a70b57f0-5786-484b-a3a7-2248ee42f435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bca1131-0f77-4c62-ad8e-853c2445b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bca1131-0f77-4c62-ad8e-853c2445b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1951501801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443fe82e-7596-4ea6-a077-d811ea7e6040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283091bc1054c88a1751fc2f8ebfd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:29Z,use_quota=True,user_id='c2912f8749234bd7984faa42d83907ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d36e05-3d78-427f-b071-6de4807b9166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d36e05-3d78-427f-b071-6de4807b9166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b1d798-fb9b-45c6-82ac-738bc204e191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b1d798-fb9b-45c6-82ac-738bc204e191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443fe82e-7596-4ea6-a077-d811ea7e6040', 'volume_name': 'volume-443fe82e-7596-4ea6-a077-d811ea7e6040', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fbde93-331f-45f1-ba28-46a0e1d0afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fbde93-331f-45f1-ba28-46a0e1d0afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56efd832-29a2-4bf1-be3c-c0c592a0cde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:28 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Volume 443fe82e-7596-4ea6-a077-d811ea7e6040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443fe82e-7596-4ea6-a077-d811ea7e6040', 'volume_size': 1} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Flow 'volume_create_manager' (59313ccf-2879-429c-a1c1-03e87b70a065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:28 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e3a821-80b9-47b1-8b03-9ed0070181a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e3a821-80b9-47b1-8b03-9ed0070181a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1315220582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a2a2d9-1f41-47b7-a206-5178a5b31f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283091bc1054c88a1751fc2f8ebfd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:29Z,use_quota=True,user_id='c2912f8749234bd7984faa42d83907ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08243a8-ce14-4939-bb2c-7d782f29e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08243a8-ce14-4939-bb2c-7d782f29e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b5138c-d5c6-424a-98cf-1fe4e17d265f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b5138c-d5c6-424a-98cf-1fe4e17d265f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a2a2d9-1f41-47b7-a206-5178a5b31f76', 'volume_name': 'volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302ed7f6-1f24-41ce-81b3-a72fd08b1438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302ed7f6-1f24-41ce-81b3-a72fd08b1438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4104eaf6-8ec0-4db8-a31a-1683997b39bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Volume b1a2a2d9-1f41-47b7-a206-5178a5b31f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76', 'volume_size': 1} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Flow 'volume_create_manager' (699aaeeb-0701-4311-8754-f501eb93e7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d7ac94-6063-467f-be3f-9b9969bf1504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d7ac94-6063-467f-be3f-9b9969bf1504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2128824285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f2f0df-0eac-4d86-a682-b23a609ded45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283091bc1054c88a1751fc2f8ebfd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:29Z,use_quota=True,user_id='c2912f8749234bd7984faa42d83907ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10af749d-01c0-4c95-8907-731b80c5c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10af749d-01c0-4c95-8907-731b80c5c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f0fec7-eebd-46cb-9e1a-81c1d1840585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f0fec7-eebd-46cb-9e1a-81c1d1840585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9f2f0df-0eac-4d86-a682-b23a609ded45', 'volume_name': 'volume-b9f2f0df-0eac-4d86-a682-b23a609ded45', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664f1ab1-5e59-42e5-9137-4e88e9ada595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664f1ab1-5e59-42e5-9137-4e88e9ada595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83415ff1-82b5-46c7-bb8c-71961f2ec129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Volume b9f2f0df-0eac-4d86-a682-b23a609ded45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9f2f0df-0eac-4d86-a682-b23a609ded45', 'volume_size': 1} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:29 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 1073741824" returned: 0 in 1.269s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:29 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 Jul 05 02:57:29 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Flow 'volume_create_manager' (d26effd6-f5c2-42cd-8b0f-eb0d69bdff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac29354c-913a-4de3-8f96-336f898ca96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac29354c-913a-4de3-8f96-336f898ca96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-913394640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283091bc1054c88a1751fc2f8ebfd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:30Z,use_quota=True,user_id='c2912f8749234bd7984faa42d83907ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feec29e2-bcea-4930-b547-5c5958ccd236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feec29e2-bcea-4930-b547-5c5958ccd236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1543b360-af6d-44b9-aadd-044cf66176d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1543b360-af6d-44b9-aadd-044cf66176d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e', 'volume_name': 'volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd886028-386f-47d2-96cd-814fc824e303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd886028-386f-47d2-96cd-814fc824e303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0288ed20-7fba-46cc-b4b9-eef6c5609eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:29 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Volume 12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e', 'volume_size': 1} Jul 05 02:57:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:30 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" returned: 0 in 0.759s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1742521988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283091bc1054c88a1751fc2f8ebfd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:28Z,use_quota=True,user_id='c2912f8749234bd7984faa42d83907ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Creating volume bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:30 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:30 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 1073741824 Jul 05 02:57:30 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335dac66-e579-4d2f-86e8-d929aef65ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a13525-bffa-40c2-8ce6-ab0e94b9ba68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:30 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 (b81fb7b8-62e4-47f4-81e4-c6c11b349e53): created successfully Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a13525-bffa-40c2-8ce6-ab0e94b9ba68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:30 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (5c576512-d841-4de7-b466-6c219f72de85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:30 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-7c5a3ca2-619d-4f03-b018-d93d2ac42454 tempest-CreateVolumesFromSnapshotTest-850428987 None] Created volume successfully. Jul 05 02:57:31 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 1073741824" returned: 0 in 1.130s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:31 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 Jul 05 02:57:31 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Flow 'volume_create_manager' (c48c82ef-c82a-46b0-b3fc-e83a3c0e4475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d591c301-994d-4631-9df7-316c69e29513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d591c301-994d-4631-9df7-316c69e29513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8f12df-8798-4837-91e9-4d20928e9dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae12a81056643a1a478b78d8740e2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:32Z,use_quota=True,user_id='c4db2f193dcb44b2be68a722afafb44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5d8ccc2-633e-4173-be50-75a42816fac5),volume_type_id=f5d8ccc2-633e-4173-be50-75a42816fac5)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c089e617-7171-4b82-bae1-8351a6dad4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c089e617-7171-4b82-bae1-8351a6dad4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de1b29d-abf4-4023-a5f1-a35bc84062b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.image.glance [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Creating Keystone auth plugin from conf {{(pid=86671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 02:57:32 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8" returned: 0 in 0.754s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.522s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1951501801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443fe82e-7596-4ea6-a077-d811ea7e6040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283091bc1054c88a1751fc2f8ebfd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:29Z,use_quota=True,user_id='c2912f8749234bd7984faa42d83907ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Creating volume 443fe82e-7596-4ea6-a077-d811ea7e6040 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:32 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:32 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040 1073741824 Jul 05 02:57:32 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef8e082-622c-45b7-b81d-1e4ee94aba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039b451a-7242-4429-a414-8c42538624a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:32 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Volume volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 (bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8): created successfully Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039b451a-7242-4429-a414-8c42538624a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Flow 'volume_create_manager' (15abf4db-dc54-4bec-bc5c-900d8c96f978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e85da19f-30e6-418a-8a7b-7b4fbfa58dc2 tempest-CreateVolumesFromImageTest-1656917103 None] Created volume successfully. Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de1b29d-abf4-4023-a5f1-a35bc84062b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d8f12df-8798-4837-91e9-4d20928e9dd9', 'volume_name': 'volume-5d8f12df-8798-4837-91e9-4d20928e9dd9', 'volume_size': 1, 'image_id': '22cce7b2-6d72-49a2-91ca-acf0271d9700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22cce7b2-6d72-49a2-91ca-acf0271d9700', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8bf5f249dd61af9d59b4c943d8addd22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ae12a81056643a1a478b78d8740e2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49fc3c41e6a52095d27820a0d6109ccfb8be72958ee096eeb30c09f68063bc728afb5bf6cadbd59c0aa55ac4f1ab9157f022e5b5565bf18b8d532d460affcabc', 'id': '22cce7b2-6d72-49a2-91ca-acf0271d9700', 'created_at': datetime.datetime(2026, 7, 5, 0, 57, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 57, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22cce7b2-6d72-49a2-91ca-acf0271d9700/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f33c2a-bf11-4470-a7cc-9489eaff8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f33c2a-bf11-4470-a7cc-9489eaff8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651ed2c4-b85c-4671-b7cb-c11233b210fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:32 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Volume 5d8f12df-8798-4837-91e9-4d20928e9dd9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d8f12df-8798-4837-91e9-4d20928e9dd9', 'volume_size': 1, 'image_id': '22cce7b2-6d72-49a2-91ca-acf0271d9700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22cce7b2-6d72-49a2-91ca-acf0271d9700', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8bf5f249dd61af9d59b4c943d8addd22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ae12a81056643a1a478b78d8740e2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49fc3c41e6a52095d27820a0d6109ccfb8be72958ee096eeb30c09f68063bc728afb5bf6cadbd59c0aa55ac4f1ab9157f022e5b5565bf18b8d532d460affcabc', 'id': '22cce7b2-6d72-49a2-91ca-acf0271d9700', 'created_at': datetime.datetime(2026, 7, 5, 0, 57, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 57, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22cce7b2-6d72-49a2-91ca-acf0271d9700/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Trying to clone 5d8f12df-8798-4837-91e9-4d20928e9dd9 from image 22cce7b2-6d72-49a2-91ca-acf0271d9700 at location (None, [{'url': 'file:///opt/stack/data/glance/images/22cce7b2-6d72-49a2-91ca-acf0271d9700', 'metadata': {}}]). {{(pid=86671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 02:57:32 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Image download 0.00 MB at 0.00 MB/s Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa4408f-210d-407d-9a37-5e5c5f53adc1]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:32 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD Jul 05 02:57:32 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:33 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040 1073741824" returned: 0 in 0.978s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:33 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040 Jul 05 02:57:33 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:33 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:33 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD Jul 05 02:57:33 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:33 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (9f1cc9e4-f9b4-4ca0-a443-5f42dd60d51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf13875-d862-4af8-bda1-575d502a9a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf13875-d862-4af8-bda1-575d502a9a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575522465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a5ae83-14ae-4fa3-852f-8a12af1bcbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:34Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5534386f-7232-422a-98fa-b5067b9ed810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5534386f-7232-422a-98fa-b5067b9ed810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c40fb9c-1833-46f8-857b-401b739e2c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c40fb9c-1833-46f8-857b-401b739e2c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a5ae83-14ae-4fa3-852f-8a12af1bcbf3', 'volume_name': 'volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1996c1b7-fb22-4031-a1e9-53526cbaac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1996c1b7-fb22-4031-a1e9-53526cbaac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43800b68-6310-4734-ae83-b6c75947e81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:34 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Volume 99a5ae83-14ae-4fa3-852f-8a12af1bcbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3', 'volume_size': 1} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:34 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040" returned: 0 in 0.681s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.123s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1315220582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a2a2d9-1f41-47b7-a206-5178a5b31f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283091bc1054c88a1751fc2f8ebfd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:29Z,use_quota=True,user_id='c2912f8749234bd7984faa42d83907ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Creating volume b1a2a2d9-1f41-47b7-a206-5178a5b31f76 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:34 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:34 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76 1073741824 Jul 05 02:57:34 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56efd832-29a2-4bf1-be3c-c0c592a0cde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443fe82e-7596-4ea6-a077-d811ea7e6040', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d53a82c-5e11-4443-b7c1-017ce6848ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:34 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Volume volume-443fe82e-7596-4ea6-a077-d811ea7e6040 (443fe82e-7596-4ea6-a077-d811ea7e6040): created successfully Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d53a82c-5e11-4443-b7c1-017ce6848ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Flow 'volume_create_manager' (a70b57f0-5786-484b-a3a7-2248ee42f435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:34 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-72c58973-f39c-425d-b4c6-d19ed1e24749 tempest-CreateVolumesFromImageTest-1656917103 None] Created volume successfully. Jul 05 02:57:34 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Temporary image 22cce7b2-6d72-49a2-91ca-acf0271d9700 is fetched for user c4db2f193dcb44b2be68a722afafb44c. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ab7593-96bd-473f-bf61-ac6e27e61dec]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:34 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD Jul 05 02:57:34 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:35 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76 1073741824" returned: 0 in 0.856s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:35 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76 Jul 05 02:57:35 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:35 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:35 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD Jul 05 02:57:35 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:35 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76" returned: 0 in 0.653s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.240s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2128824285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f2f0df-0eac-4d86-a682-b23a609ded45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283091bc1054c88a1751fc2f8ebfd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:29Z,use_quota=True,user_id='c2912f8749234bd7984faa42d83907ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Creating volume b9f2f0df-0eac-4d86-a682-b23a609ded45 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:35 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4104eaf6-8ec0-4db8-a31a-1683997b39bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:35 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45 1073741824 Jul 05 02:57:35 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0dd674-06a0-45b4-a79c-aac2dcdd29a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:35 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Volume volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76 (b1a2a2d9-1f41-47b7-a206-5178a5b31f76): created successfully Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0dd674-06a0-45b4-a79c-aac2dcdd29a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Flow 'volume_create_manager' (59313ccf-2879-429c-a1c1-03e87b70a065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-87901256-4ed1-4759-9bb9-81579833f53a tempest-CreateVolumesFromImageTest-1656917103 None] Created volume successfully. Jul 05 02:57:35 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD" returned: 1 in 0.740s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:57:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:36 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45 1073741824" returned: 0 in 0.847s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:36 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45 Jul 05 02:57:36 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:37 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45" returned: 0 in 0.642s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.294s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-913394640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7283091bc1054c88a1751fc2f8ebfd1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:30Z,use_quota=True,user_id='c2912f8749234bd7984faa42d83907ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Creating volume 12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:37 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83415ff1-82b5-46c7-bb8c-71961f2ec129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9f2f0df-0eac-4d86-a682-b23a609ded45', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd3f480-4c65-4711-ae89-929b852ee23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:37 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e 1073741824 Jul 05 02:57:37 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:37 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Volume volume-b9f2f0df-0eac-4d86-a682-b23a609ded45 (b9f2f0df-0eac-4d86-a682-b23a609ded45): created successfully Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd3f480-4c65-4711-ae89-929b852ee23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:37 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Flow 'volume_create_manager' (699aaeeb-0701-4311-8754-f501eb93e7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:37 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5d79d25b-6b41-4d5b-a556-4847ea3771bf tempest-CreateVolumesFromImageTest-1656917103 None] Created volume successfully. Jul 05 02:57:38 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e 1073741824" returned: 0 in 0.802s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:38 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e Jul 05 02:57:38 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:38 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e" returned: 0 in 0.621s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.051s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0288ed20-7fba-46cc-b4b9-eef6c5609eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc19326-de20-4f38-86be-3b051ab49abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Creating offline snapshot a04ec9e4-c8f2-478e-ab56-53921d5d48e4 of volume b81fb7b8-62e4-47f4-81e4-c6c11b349e53 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:57:38 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Volume volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e (12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e): created successfully Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc19326-de20-4f38-86be-3b051ab49abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Flow 'volume_create_manager' (d26effd6-f5c2-42cd-8b0f-eb0d69bdff5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d716dec8-7851-459a-8985-e4b538b66194]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:38 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-bbd92641-57ea-4555-a94e-361ff6e41e1c tempest-CreateVolumesFromImageTest-1656917103 None] Created volume successfully. Jul 05 02:57:38 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 Jul 05 02:57:38 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:39 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" returned: 0 in 0.741s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:39 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 1G Jul 05 02:57:39 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "cinder-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "cinder-quobyte-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-quobyte-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:39 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[12644bdf-e29d-41f2-ac14-061975834975]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:39 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e Jul 05 02:57:39 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:40 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 1G" returned: 0 in 0.820s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:40 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 Jul 05 02:57:40 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:40 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e" returned: 0 in 0.765s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:40 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e Jul 05 02:57:40 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:41 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4" returned: 0 in 0.681s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:41 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 is being set with open permissions: ugo+rw Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:41 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 Jul 05 02:57:41 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:41 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e" returned: 0 in 0.646s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-quobyte-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e" released by "delete_volume" :: held 1.461s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Created reservations ['c1c648c4-a385-4ece-b456-8bbc4b2e4aa8', '65e1d27a-b530-4112-a635-80ec9c457227', 'e039ab3a-7902-451a-b82b-569130dbb48b', '5fc5799e-c8c8-489b-8a04-fa4c92599aed'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:41 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:41 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:41 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4" returned: 0 in 0.652s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:41 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.info Jul 05 02:57:41 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "cinder-b9f2f0df-0eac-4d86-a682-b23a609ded45-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-b9f2f0df-0eac-4d86-a682-b23a609ded45-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "cinder-quobyte-b9f2f0df-0eac-4d86-a682-b23a609ded45" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-quobyte-b9f2f0df-0eac-4d86-a682-b23a609ded45" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:41 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.653s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:41 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:42 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Deleted volume successfully. Jul 05 02:57:42 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed247014-a40f-40fc-b60c-f40b1094c219]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9c6eb89a-31d9-4798-b91e-a8d4f590f3b2 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-12c5ad43-f47e-4a16-9dd0-cf8ac7bdf47e-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:42 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45 Jul 05 02:57:42 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:42 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.info" returned: 0 in 0.688s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:42 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.info is being set with open permissions: ugo+rw Jul 05 02:57:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:42 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.info Jul 05 02:57:42 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:42 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45" returned: 0 in 0.773s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:42 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45 Jul 05 02:57:42 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:43 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.info" returned: 0 in 0.662s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.355s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.069s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575522465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a5ae83-14ae-4fa3-852f-8a12af1bcbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:34Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Creating volume 99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:43 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:43 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 1073741824 Jul 05 02:57:43 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c49f6061-7367-495c-aff9-b96e7a4aba02 tempest-CreateVolumesFromSnapshotTest-850428987 None] Create snapshot completed successfully Jul 05 02:57:43 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b9f2f0df-0eac-4d86-a682-b23a609ded45" returned: 0 in 0.659s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-quobyte-b9f2f0df-0eac-4d86-a682-b23a609ded45" released by "delete_volume" :: held 1.495s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Created reservations ['d452bcfb-8e53-4883-a17a-473fb7ad6bb2', 'b9df696b-6d6b-4ac3-8707-29971bf64856', '8353765c-aa76-4863-9505-f665b54e7900', '88bf162a-2848-4f38-9c6a-71f5cdfa2ca1'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:43 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:43 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:43 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 1073741824" returned: 0 in 0.828s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:44 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 Jul 05 02:57:44 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "cinder-b1a2a2d9-1f41-47b7-a206-5178a5b31f76-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-b1a2a2d9-1f41-47b7-a206-5178a5b31f76-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "cinder-quobyte-b1a2a2d9-1f41-47b7-a206-5178a5b31f76" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-quobyte-b1a2a2d9-1f41-47b7-a206-5178a5b31f76" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff398d9-01d8-41b1-a7f7-0422cefa7df6]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:44 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.769s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Deleted volume successfully. Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e18d7674-e139-4fbc-8ad3-331258cadba9 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-b9f2f0df-0eac-4d86-a682-b23a609ded45-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:44 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76 Jul 05 02:57:44 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:44 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" returned: 0 in 0.768s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.794s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d8f12df-8798-4837-91e9-4d20928e9dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae12a81056643a1a478b78d8740e2e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:32Z,use_quota=True,user_id='c4db2f193dcb44b2be68a722afafb44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5d8ccc2-633e-4173-be50-75a42816fac5),volume_type_id=f5d8ccc2-633e-4173-be50-75a42816fac5)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Creating volume 5d8f12df-8798-4837-91e9-4d20928e9dd9 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:44 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:44 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 1073741824 Jul 05 02:57:44 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (c63bbec4-7145-4d69-97a6-0e2a71415ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad126eef-9031-437e-862d-51efb7f49bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43800b68-6310-4734-ae83-b6c75947e81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb07ee3b-f413-4324-a378-ec51701cd9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad126eef-9031-437e-862d-51efb7f49bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847665295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadef929-f795-479e-a600-fe321b5378e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:45Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d822a57-ed05-4954-a5ee-4319f58e398d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d822a57-ed05-4954-a5ee-4319f58e398d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97238a4d-0a7d-43fb-a854-122bff1fe947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97238a4d-0a7d-43fb-a854-122bff1fe947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dadef929-f795-479e-a600-fe321b5378e2', 'volume_name': 'volume-dadef929-f795-479e-a600-fe321b5378e2', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5deed4-ebd4-4665-81b3-5a1c5c0ab85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5deed4-ebd4-4665-81b3-5a1c5c0ab85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937a11d4-374f-4cec-9ede-c4b0d2f5b67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:44 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume dadef929-f795-479e-a600-fe321b5378e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dadef929-f795-479e-a600-fe321b5378e2', 'volume_size': 1} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:44 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Volume volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 (99a5ae83-14ae-4fa3-852f-8a12af1bcbf3): created successfully Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb07ee3b-f413-4324-a378-ec51701cd9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (9f1cc9e4-f9b4-4ca0-a443-5f42dd60d51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-87c1f4e7-d60d-4658-8289-67aa6c91d2e6 tempest-ProjectReaderTests-82563222 None] Created volume successfully. Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (4607e937-fa82-4bf9-af6d-5f6efa75191b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9eb1b84-f4fd-4151-970d-e86ebf3a29bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9eb1b84-f4fd-4151-970d-e86ebf3a29bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1388843793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2756a2bd-125d-4739-bbf5-8f4bb26a9aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:45Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c15a11-aa74-4706-966f-e43795315f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c15a11-aa74-4706-966f-e43795315f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2b3f02-9bc1-4d34-aa6f-78adad4d35a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2b3f02-9bc1-4d34-aa6f-78adad4d35a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2756a2bd-125d-4739-bbf5-8f4bb26a9aaa', 'volume_name': 'volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b5916c-1b2e-4838-aa73-c6d8fe23bbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:45 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b5916c-1b2e-4838-aa73-c6d8fe23bbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45eec76a-6a94-4f83-b1a4-92b182b89a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:45 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume 2756a2bd-125d-4739-bbf5-8f4bb26a9aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa', 'volume_size': 1} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76" returned: 0 in 1.014s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:45 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76 Jul 05 02:57:45 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (5f17b7ef-708e-4c90-85df-3c3622314059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3295ebe4-739f-4659-885b-ee3c2b651c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3295ebe4-739f-4659-885b-ee3c2b651c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-139835284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17f4399-a845-415c-be80-6f2181866644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:46Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c0413b-1886-4500-9459-278940aede3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c0413b-1886-4500-9459-278940aede3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6b0515-3395-43af-849a-ffdc18dc1869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6b0515-3395-43af-849a-ffdc18dc1869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17f4399-a845-415c-be80-6f2181866644', 'volume_name': 'volume-e17f4399-a845-415c-be80-6f2181866644', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5601b2ed-78f2-4f72-a0e3-c7fa699dcc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5601b2ed-78f2-4f72-a0e3-c7fa699dcc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b803331-1855-4a21-a935-f28d27e33f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:45 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume e17f4399-a845-415c-be80-6f2181866644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17f4399-a845-415c-be80-6f2181866644', 'volume_size': 1} Jul 05 02:57:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (c66c96e6-46c1-40b2-b070-a326696301dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6683c621-15ea-4e42-84a1-fb6d0278e153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:46 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6683c621-15ea-4e42-84a1-fb6d0278e153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1904909058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a8719e-fbcb-40cd-b4dd-37e19c872e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:46Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387da6a7-8527-487d-9eaf-271c23865e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387da6a7-8527-487d-9eaf-271c23865e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12137e4-050f-4e3b-9f27-c59683a693ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12137e4-050f-4e3b-9f27-c59683a693ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a8719e-fbcb-40cd-b4dd-37e19c872e87', 'volume_name': 'volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c99152a-8b7b-4ef8-90f2-ac841b366926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c99152a-8b7b-4ef8-90f2-ac841b366926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411bc041-8376-477e-bde4-e55aae9e7ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:46 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume 79a8719e-fbcb-40cd-b4dd-37e19c872e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87', 'volume_size': 1} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 1073741824" returned: 0 in 1.425s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:46 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 Jul 05 02:57:46 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:46 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1a2a2d9-1f41-47b7-a206-5178a5b31f76" returned: 0 in 1.033s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-quobyte-b1a2a2d9-1f41-47b7-a206-5178a5b31f76" released by "delete_volume" :: held 2.107s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (b2236810-b215-4473-959e-73363587d0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b8e228-a046-41f4-ba05-50c891d3dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Created reservations ['67e895ca-799e-4fe7-bf71-6c5c8b0692ce', 'a64d368a-2e35-40a7-a8d8-8fa1e3738e03', '13ad4f3d-6e3c-4d39-aad0-18b5f8ee1880', '9f8924c0-56fe-4601-a6c9-ca4e2576f3be'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b8e228-a046-41f4-ba05-50c891d3dab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654781107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2adec4-99d0-4ffd-ae69-afcafee77f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:46Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db39c6af-3841-46d5-9799-66275ff68d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db39c6af-3841-46d5-9799-66275ff68d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b31969e-44e6-4993-a1d5-87abe212f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b31969e-44e6-4993-a1d5-87abe212f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e2adec4-99d0-4ffd-ae69-afcafee77f52', 'volume_name': 'volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95471ba7-9dff-4835-8f10-f150306d875f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95471ba7-9dff-4835-8f10-f150306d875f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa3a43d-dfd0-4f69-956c-e341d0011f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:46 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume 1e2adec4-99d0-4ffd-ae69-afcafee77f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52', 'volume_size': 1} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:46 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:46 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:46 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9" returned: 0 in 0.691s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847665295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadef929-f795-479e-a600-fe321b5378e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:45Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Creating volume dadef929-f795-479e-a600-fe321b5378e2 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:46 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:46 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2 1073741824 Jul 05 02:57:46 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:46 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Attempting download of 22cce7b2-6d72-49a2-91ca-acf0271d9700 ((None, [{'url': 'file:///opt/stack/data/glance/images/22cce7b2-6d72-49a2-91ca-acf0271d9700', 'metadata': {}}])) to volume 5d8f12df-8798-4837-91e9-4d20928e9dd9. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf082bee-69fd-44ec-9bcf-dba8a215a29b]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22cce7b2-6d72-49a2-91ca-acf0271d9700_oa9c84um {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:47 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22cce7b2-6d72-49a2-91ca-acf0271d9700_oa9c84um Jul 05 02:57:47 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:47 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.693s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:47 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Deleted volume successfully. Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e5b940ed-896e-4eae-bd06-89eeff3df1e0 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-b1a2a2d9-1f41-47b7-a206-5178a5b31f76-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "cinder-443fe82e-7596-4ea6-a077-d811ea7e6040-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-443fe82e-7596-4ea6-a077-d811ea7e6040-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "cinder-quobyte-443fe82e-7596-4ea6-a077-d811ea7e6040" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-quobyte-443fe82e-7596-4ea6-a077-d811ea7e6040" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2ce496-4c3d-4b77-9cce-14799a58cf5e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:47 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040 Jul 05 02:57:47 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:47 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22cce7b2-6d72-49a2-91ca-acf0271d9700_oa9c84um" returned: 0 in 0.765s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22cce7b2-6d72-49a2-91ca-acf0271d9700_oa9c84um {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:47 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2 1073741824" returned: 0 in 0.895s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:47 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2 Jul 05 02:57:47 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:47 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22cce7b2-6d72-49a2-91ca-acf0271d9700_oa9c84um Jul 05 02:57:47 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:48 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040" returned: 0 in 0.779s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:48 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040 Jul 05 02:57:48 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:48 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2" returned: 0 in 0.698s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.270s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1388843793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2756a2bd-125d-4739-bbf5-8f4bb26a9aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:45Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Creating volume 2756a2bd-125d-4739-bbf5-8f4bb26a9aaa {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:48 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:48 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa 1073741824 Jul 05 02:57:48 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:48 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937a11d4-374f-4cec-9ede-c4b0d2f5b67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dadef929-f795-479e-a600-fe321b5378e2', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597c1eba-6c8b-42b4-ae25-9df7cb887110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22cce7b2-6d72-49a2-91ca-acf0271d9700_oa9c84um" returned: 1 in 0.819s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22cce7b2-6d72-49a2-91ca-acf0271d9700_oa9c84um' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcde463-c5d9-48b2-930c-35d61de75af4]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:48 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume volume-dadef929-f795-479e-a600-fe321b5378e2 (dadef929-f795-479e-a600-fe321b5378e2): created successfully Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597c1eba-6c8b-42b4-ae25-9df7cb887110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (c63bbec4-7145-4d69-97a6-0e2a71415ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:48 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1e3f0ba2-7390-4120-9626-5090d7f5f3ca tempest-CreateVolumesFromSnapshotTest-850428987 None] Created volume successfully. Jul 05 02:57:48 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD Jul 05 02:57:48 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:49 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-443fe82e-7596-4ea6-a077-d811ea7e6040" returned: 0 in 0.671s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-quobyte-443fe82e-7596-4ea6-a077-d811ea7e6040" released by "delete_volume" :: held 1.488s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Created reservations ['38d06b85-fa21-47fe-b080-b13308ad69e8', '3a902b0d-2c9b-4a52-a73b-576f7160dbc1', '806f4201-f9b3-484b-9b0a-65bfdfc012c5', 'cc5231ec-36f4-4821-bad5-4764f102ed89'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:49 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:49 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:49 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:49 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD" returned: 0 in 0.800s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa 1073741824" returned: 0 in 0.875s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:49 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa Jul 05 02:57:49 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:49 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD Jul 05 02:57:49 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "cinder-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "cinder-quobyte-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-quobyte-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0786c33e-77b8-4d59-ae2d-d032abfa67b5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:49 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.707s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:49 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Deleted volume successfully. Jul 05 02:57:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0be1b67-6169-4c9b-a64d-0b72f5d70fea tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-443fe82e-7596-4ea6-a077-d811ea7e6040-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:50 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 Jul 05 02:57:50 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:50 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa" returned: 0 in 0.728s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.514s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-139835284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17f4399-a845-415c-be80-6f2181866644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:46Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Creating volume e17f4399-a845-415c-be80-6f2181866644 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:50 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:50 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45eec76a-6a94-4f83-b1a4-92b182b89a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:50 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644 1073741824 Jul 05 02:57:50 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5c5d63-fa47-4570-be9b-b3b306f86dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD" returned: 1 in 0.841s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] 22cce7b2-6d72-49a2-91ca-acf0271d9700 was raw, converting to raw {{(pid=86671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:50 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa (2756a2bd-125d-4739-bbf5-8f4bb26a9aaa): created successfully Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5c5d63-fa47-4570-be9b-b3b306f86dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:50 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 Jul 05 02:57:50 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (4607e937-fa82-4bf9-af6d-5f6efa75191b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-15d4e413-00db-4822-96cb-a8657555ab40 tempest-CreateVolumesFromSnapshotTest-850428987 None] Created volume successfully. Jul 05 02:57:50 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8" returned: 0 in 0.809s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:50 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8 Jul 05 02:57:50 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:51 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9" returned: 0 in 0.787s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_22cce7b2-6d72-49a2-91ca-acf0271d9700_05y24w9edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:57:51 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:51 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 1G Jul 05 02:57:51 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:51 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644 1073741824" returned: 0 in 0.874s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:51 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644 Jul 05 02:57:51 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:51 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8" returned: 0 in 0.711s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-quobyte-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8" released by "delete_volume" :: held 1.570s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Created reservations ['a3a4f91d-3d36-4e4b-9198-0ea4e61c261a', '008a50cf-eed6-4c68-88f3-c38de5a7615e', 'd3f72a8c-6c34-4d31-8ada-d508396e927a', '88613ca6-f022-431d-aef6-ddc23e429078'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:51 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:51 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:51 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 1G" returned: 0 in 0.744s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f8b432-e972-4f79-a513-6bda390578ed]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:51 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644" returned: 0 in 0.736s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.819s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b803331-1855-4a21-a935-f28d27e33f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17f4399-a845-415c-be80-6f2181866644', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5a1218-624f-41cb-99d5-a179bdc3f565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Creating offline snapshot 2960d2ab-46de-45e6-a397-0e8442b321db of volume 99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:57:51 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume volume-e17f4399-a845-415c-be80-6f2181866644 (e17f4399-a845-415c-be80-6f2181866644): created successfully Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5a1218-624f-41cb-99d5-a179bdc3f565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (5f17b7ef-708e-4c90-85df-3c3622314059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac1ec04-11e9-44b9-94f8-0c0031a044ca]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:51 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 Jul 05 02:57:51 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9e44460b-23d3-44d2-9581-e7f023c48bb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Created volume successfully. Jul 05 02:57:52 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 Jul 05 02:57:52 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:52 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.737s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:52 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Deleted volume successfully. Jul 05 02:57:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-61731c41-9a4c-43ee-9f37-a7154759d232 tempest-CreateVolumesFromImageTest-1656917103 None] Lock "cinder-bc6ee9d2-89cc-4ec7-b66b-8d2ef66da4f8-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:52 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9" returned: 0 in 0.825s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:52 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 Jul 05 02:57:52 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:52 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" returned: 0 in 1.017s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:53 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db 1G Jul 05 02:57:53 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:53 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9" returned: 1 in 0.923s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Downloaded image 22cce7b2-6d72-49a2-91ca-acf0271d9700 ((None, [{'url': 'file:///opt/stack/data/glance/images/22cce7b2-6d72-49a2-91ca-acf0271d9700', 'metadata': {}}])) to volume 5d8f12df-8798-4837-91e9-4d20928e9dd9 successfully. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Temporary image 22cce7b2-6d72-49a2-91ca-acf0271d9700 for user c4db2f193dcb44b2be68a722afafb44c is deleted. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Marking volume 5d8f12df-8798-4837-91e9-4d20928e9dd9 as bootable. {{(pid=86671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Copying metadata from image 22cce7b2-6d72-49a2-91ca-acf0271d9700 to 5d8f12df-8798-4837-91e9-4d20928e9dd9. {{(pid=86671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Creating volume glance metadata for volume 5d8f12df-8798-4837-91e9-4d20928e9dd9 backed by image 22cce7b2-6d72-49a2-91ca-acf0271d9700 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '22cce7b2-6d72-49a2-91ca-acf0271d9700', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8bf5f249dd61af9d59b4c943d8addd22', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651ed2c4-b85c-4671-b7cb-c11233b210fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d8f12df-8798-4837-91e9-4d20928e9dd9', 'volume_size': 1, 'image_id': '22cce7b2-6d72-49a2-91ca-acf0271d9700', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22cce7b2-6d72-49a2-91ca-acf0271d9700', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8bf5f249dd61af9d59b4c943d8addd22', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ae12a81056643a1a478b78d8740e2e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49fc3c41e6a52095d27820a0d6109ccfb8be72958ee096eeb30c09f68063bc728afb5bf6cadbd59c0aa55ac4f1ab9157f022e5b5565bf18b8d532d460affcabc', 'id': '22cce7b2-6d72-49a2-91ca-acf0271d9700', 'created_at': datetime.datetime(2026, 7, 5, 0, 57, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 57, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22cce7b2-6d72-49a2-91ca-acf0271d9700/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b62b688-e278-45f0-8aec-63fe32b57d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:53 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Volume volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 (5d8f12df-8798-4837-91e9-4d20928e9dd9): created successfully Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b62b688-e278-45f0-8aec-63fe32b57d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Flow 'volume_create_manager' (c48c82ef-c82a-46b0-b3fc-e83a3c0e4475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:53 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3b968404-04e5-4411-8894-da9997764cc3 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Created volume successfully. Jul 05 02:57:53 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db 1G" returned: 0 in 0.925s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:53 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db Jul 05 02:57:53 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:54 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db" returned: 0 in 0.688s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:54 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db is being set with open permissions: ugo+rw Jul 05 02:57:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:54 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db Jul 05 02:57:54 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Acquiring lock "cinder-5d8f12df-8798-4837-91e9-4d20928e9dd9-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Lock "cinder-5d8f12df-8798-4837-91e9-4d20928e9dd9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Acquiring lock "cinder-quobyte-5d8f12df-8798-4837-91e9-4d20928e9dd9" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Lock "cinder-quobyte-5d8f12df-8798-4837-91e9-4d20928e9dd9" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:54 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3649f2-6877-40a1-8656-cbf1a0644427]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:54 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 Jul 05 02:57:54 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (5bbb2bd9-4522-45ff-b8a0-193bfee102ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb75f11a-b9af-4ef7-9a6b-d2bacb5f8d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb75f11a-b9af-4ef7-9a6b-d2bacb5f8d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2077196332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abdaebe6-0bf4-4098-b8ad-1e58217bea55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:55Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e9b31a-083a-4a3b-b8ed-cddaa95878f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e9b31a-083a-4a3b-b8ed-cddaa95878f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a771ad-d4b5-4470-8a87-3821df0e2262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a771ad-d4b5-4470-8a87-3821df0e2262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abdaebe6-0bf4-4098-b8ad-1e58217bea55', 'volume_name': 'volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983f0101-b29e-4a8f-837f-1c7816a5abc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983f0101-b29e-4a8f-837f-1c7816a5abc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8deda4a2-6232-4981-8fbd-4b1c8c478e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:55 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume abdaebe6-0bf4-4098-b8ad-1e58217bea55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55', 'volume_size': 1} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:55 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db" returned: 0 in 0.743s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:55 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.info Jul 05 02:57:55 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:55 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9" returned: 0 in 0.830s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:55 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 Jul 05 02:57:55 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:56 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.info" returned: 0 in 0.667s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:56 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.info is being set with open permissions: ugo+rw Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:56 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.info Jul 05 02:57:56 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:56 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9" returned: 1 in 0.777s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:56 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9 Jul 05 02:57:56 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:56 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.info" returned: 0 in 0.676s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.838s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.557s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1904909058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a8719e-fbcb-40cd-b4dd-37e19c872e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:46Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Creating volume 79a8719e-fbcb-40cd-b4dd-37e19c872e87 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:56 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:56 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87 1073741824 Jul 05 02:57:56 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8cbcec8a-24f1-40b4-b108-8354ae614d5d tempest-ProjectReaderTests-82563222 None] Create snapshot completed successfully Jul 05 02:57:57 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d8f12df-8798-4837-91e9-4d20928e9dd9" returned: 0 in 0.645s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Lock "cinder-quobyte-5d8f12df-8798-4837-91e9-4d20928e9dd9" released by "delete_volume" :: held 2.327s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Created reservations ['b50da534-8bfa-4f08-a634-13a85ad0af26', 'b13efd19-7358-4e22-935e-0160fb39ec29', '239f6c3e-dfea-483d-912a-3ba8a14e0482', '28705c64-9108-43d7-bb88-f7d52cbe7168'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:57 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:57:57 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-2960d2ab-46de-45e6-a397-0e8442b321db-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Lock "cinder-2960d2ab-46de-45e6-a397-0e8442b321db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:57 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87 1073741824" returned: 0 in 0.914s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-2960d2ab-46de-45e6-a397-0e8442b321db" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-2960d2ab-46de-45e6-a397-0e8442b321db" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Deleting offline snapshot 2960d2ab-46de-45e6-a397-0e8442b321db of volume 99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] snapshot_file for this snap is: volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab19ee2-64cf-4491-a640-ce7cc93b9dc5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:57 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87 Jul 05 02:57:57 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:57 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db Jul 05 02:57:57 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:57 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.687s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:57:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Deleted volume successfully. Jul 05 02:57:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8d28b2a6-116c-462e-8932-3f6edc0754c9 tempest-VolumeAndVolumeTypeFromImageTest-100204614 None] Lock "cinder-5d8f12df-8798-4837-91e9-4d20928e9dd9-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:57:58 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87" returned: 0 in 0.687s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.912s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654781107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2adec4-99d0-4ffd-ae69-afcafee77f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421c37a2c0854d1ea3d612082e84a54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:46Z,use_quota=True,user_id='f559f638fe4146cca85a46792a9a38b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Creating volume 1e2adec4-99d0-4ffd-ae69-afcafee77f52 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:57:58 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411bc041-8376-477e-bde4-e55aae9e7ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:58 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52 1073741824 Jul 05 02:57:58 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d930034-28ae-4d15-bfe9-fc73d6988528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:57:58 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87 (79a8719e-fbcb-40cd-b4dd-37e19c872e87): created successfully Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d930034-28ae-4d15-bfe9-fc73d6988528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (c66c96e6-46c1-40b2-b070-a326696301dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:57:58 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c850f0e6-e5ac-4631-a596-6630ed07db69 tempest-CreateVolumesFromSnapshotTest-850428987 None] Created volume successfully. Jul 05 02:57:58 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db" returned: 0 in 0.871s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[debd456c-eae3-4cf7-8394-b34b8b4c31ee]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:57:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:58 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 Jul 05 02:57:58 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:59 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52 1073741824" returned: 0 in 1.046s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:59 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52 Jul 05 02:57:59 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:57:59 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 05 02:57:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" returned: 0 in 0.963s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:57:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:57:59 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db Jul 05 02:57:59 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:00 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52" returned: 0 in 0.753s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.057s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2077196332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abdaebe6-0bf4-4098-b8ad-1e58217bea55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:57:55Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Creating volume abdaebe6-0bf4-4098-b8ad-1e58217bea55 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:00 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa3a43d-dfd0-4f69-956c-e341d0011f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:00 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55 1073741824 Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5f8e83-aaab-4b0a-bb0d-8f7da4d94f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:00 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:00 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Volume volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52 (1e2adec4-99d0-4ffd-ae69-afcafee77f52): created successfully Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5f8e83-aaab-4b0a-bb0d-8f7da4d94f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Flow 'volume_create_manager' (b2236810-b215-4473-959e-73363587d0df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:00 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-34e44c60-c858-47ee-9a44-60f7dce79204 tempest-CreateVolumesFromSnapshotTest-850428987 None] Created volume successfully. Jul 05 02:58:00 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db" returned: 0 in 0.837s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:00 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db Jul 05 02:58:00 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-1e2adec4-99d0-4ffd-ae69-afcafee77f52-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-1e2adec4-99d0-4ffd-ae69-afcafee77f52-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-quobyte-1e2adec4-99d0-4ffd-ae69-afcafee77f52" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-1e2adec4-99d0-4ffd-ae69-afcafee77f52" acquired by "delete_volume" :: waited 0.029s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ebd16e-2229-4e48-a05a-a2dfdc8bcee0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:00 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52 Jul 05 02:58:00 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:01 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3.2960d2ab-46de-45e6-a397-0e8442b321db" returned: 0 in 0.851s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-2960d2ab-46de-45e6-a397-0e8442b321db" released by "_delete_snapshot" :: held 3.640s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" released by "delete_snapshot" :: held 3.669s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:01 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55 1073741824" returned: 0 in 1.096s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Created reservations ['fbd5a8fd-6688-439e-95b6-38398ea2dce7', '1f90896a-7010-4111-8a76-8d3b02546b67', '632f53f6-c5a5-4835-a38f-9f7ffe6860dd', '711a39cf-d812-4203-bc0d-c0d475bb96ab'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:01 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55 Jul 05 02:58:01 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:01 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Delete snapshot completed successfully. Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99f60eb0-fc00-4b87-afc1-9b2dc4f78135 tempest-ProjectReaderTests-82563222 None] Lock "cinder-2960d2ab-46de-45e6-a397-0e8442b321db-delete_snapshot" released by "delete_snapshot" :: held 3.893s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:01 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52" returned: 0 in 0.893s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:01 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52 Jul 05 02:58:01 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Lock "cinder-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc21322-da79-4865-9c20-ad80656494ee]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:02 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 Jul 05 02:58:02 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:02 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55" returned: 0 in 0.796s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8deda4a2-6232-4981-8fbd-4b1c8c478e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb7d7bb-1d4e-4b9a-a69e-1d59faa0abd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:02 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55 (abdaebe6-0bf4-4098-b8ad-1e58217bea55): created successfully Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb7d7bb-1d4e-4b9a-a69e-1d59faa0abd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (5bbb2bd9-4522-45ff-b8a0-193bfee102ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:02 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-bdb4989e-b3c9-4e42-8cbd-fe8747de84a1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created volume successfully. Jul 05 02:58:02 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-1e2adec4-99d0-4ffd-ae69-afcafee77f52" returned: 0 in 0.837s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-1e2adec4-99d0-4ffd-ae69-afcafee77f52" released by "delete_volume" :: held 1.784s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Created reservations ['e5a0a9c3-4de8-4769-b9ac-66644c9def11', 'b9c50791-12cf-47a9-945c-0ca190a744ad', '73fa2aff-288c-499f-a40f-b0cc86d85919', '74c52357-150f-4e8c-8c10-1abe6264af6f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:02 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:02 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:02 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" returned: 0 in 0.874s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-79a8719e-fbcb-40cd-b4dd-37e19c872e87-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:03 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3 Jul 05 02:58:03 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Flow 'volume_create_manager' (1ce2f09c-2b5c-45be-ad19-ca6374fe1df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc486242-4367-4b4c-a3ac-2fff2b7236bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-79a8719e-fbcb-40cd-b4dd-37e19c872e87-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc486242-4367-4b4c-a3ac-2fff2b7236bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbe6514-24ae-4a46-b477-95e7e06e61db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b6c53db23644fd844ed01c85115e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:03Z,use_quota=True,user_id='32f59313908545d7a9baef62b44f8370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131ae3fa-8dfd-4402-adbe-5a03f33cc2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (131ae3fa-8dfd-4402-adbe-5a03f33cc2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a7924c-39e3-4e8b-b288-51a1c63ed44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a7924c-39e3-4e8b-b288-51a1c63ed44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbe6514-24ae-4a46-b477-95e7e06e61db', 'volume_name': 'volume-2dbe6514-24ae-4a46-b477-95e7e06e61db', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228b5c99-620a-48e0-8400-ce7fbf668711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228b5c99-620a-48e0-8400-ce7fbf668711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e43bc00-dcc3-4f35-a518-614a56d2b28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:03 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Volume 2dbe6514-24ae-4a46-b477-95e7e06e61db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbe6514-24ae-4a46-b477-95e7e06e61db', 'volume_size': 1} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbe6514-24ae-4a46-b477-95e7e06e61db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b6c53db23644fd844ed01c85115e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:03Z,use_quota=True,user_id='32f59313908545d7a9baef62b44f8370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Creating volume 2dbe6514-24ae-4a46-b477-95e7e06e61db {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:03 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-quobyte-79a8719e-fbcb-40cd-b4dd-37e19c872e87" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:03 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db 1073741824 Jul 05 02:58:03 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-79a8719e-fbcb-40cd-b4dd-37e19c872e87" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a54d9c-bbe0-45c3-b9f6-16eabf01c153]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:03 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87 Jul 05 02:58:03 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:03 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.091s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Deleted volume successfully. Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-debe3b03-e28f-4b7c-bf90-5d0fed5f6d4d tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-1e2adec4-99d0-4ffd-ae69-afcafee77f52-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:03 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (85a6d258-0640-4d56-ba6d-0a812f7e692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:04 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e01d5b5-baff-4523-8a30-9ab6fc0c8246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" returned: 0 in 1.057s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e01d5b5-baff-4523-8a30-9ab6fc0c8246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1764184714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efb460d-9a27-4c2a-a13d-de268edfbfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:04Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe81480f-ed25-4f75-b97d-f15ae8dba4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe81480f-ed25-4f75-b97d-f15ae8dba4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e3a0b0-4932-419f-b319-bf110eb7df3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e3a0b0-4932-419f-b319-bf110eb7df3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7efb460d-9a27-4c2a-a13d-de268edfbfb2', 'volume_name': 'volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed53da9a-6445-4cbf-9fb9-1727ac3f18be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed53da9a-6445-4cbf-9fb9-1727ac3f18be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3991bf-5c69-4dee-90c2-4a704993a24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume 7efb460d-9a27-4c2a-a13d-de268edfbfb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2', 'volume_size': 1} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3" released by "delete_volume" :: held 2.118s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Created reservations ['dcb216ed-0893-457b-9b8f-29101d7c7ebf', '24c1506c-7f98-4c11-b453-5b175bef30e0', 'b7644069-3ec0-4ce2-a2b8-4853fff34170', 'c638a19f-a906-44a7-9fbc-44db1e182369'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (bdd48534-1d41-4c4f-a34c-b304ce942b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389a2084-2aeb-4733-b8d8-dc1aa39adbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (389a2084-2aeb-4733-b8d8-dc1aa39adbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1374869970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7698854c-734b-4c02-b6eb-ae1b813c5b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:04Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c49e78-2ec9-425b-ab2d-627d60ac1f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c49e78-2ec9-425b-ab2d-627d60ac1f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c80f436-05a8-45aa-91ff-9b1af128d66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c80f436-05a8-45aa-91ff-9b1af128d66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7698854c-734b-4c02-b6eb-ae1b813c5b54', 'volume_name': 'volume-7698854c-734b-4c02-b6eb-ae1b813c5b54', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9adaf5-9c04-464c-95e6-7249f40abdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9adaf5-9c04-464c-95e6-7249f40abdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90e2d7e-7e82-4338-863a-5c706603612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume 7698854c-734b-4c02-b6eb-ae1b813c5b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7698854c-734b-4c02-b6eb-ae1b813c5b54', 'volume_size': 1} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:04 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87" returned: 0 in 1.281s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:04 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87 Jul 05 02:58:04 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:04 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:04 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db 1073741824" returned: 0 in 1.462s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:04 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (36c2a500-94ab-4aa7-b907-ca6ed9995ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1c1529-4769-40c6-ad80-bd17e20ef339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1c1529-4769-40c6-ad80-bd17e20ef339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-697536740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdc2f7b-5ada-4c02-8cdc-4881305b9763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:05Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f9d725-4820-4784-accf-ff0fdec745ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f9d725-4820-4784-accf-ff0fdec745ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c997e5-fd11-49a5-9228-13de9451018e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c997e5-fd11-49a5-9228-13de9451018e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bdc2f7b-5ada-4c02-8cdc-4881305b9763', 'volume_name': 'volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dd195d-270f-4fc0-a018-e5c5ecf7dca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dd195d-270f-4fc0-a018-e5c5ecf7dca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801c9c0a-5330-4e08-b315-d4b904276518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:04 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume 6bdc2f7b-5ada-4c02-8cdc-4881305b9763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763', 'volume_size': 1} Jul 05 02:58:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (6920003f-2ba6-4a37-b59c-0c978755b998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b6e801-227c-4d41-868b-df106c97182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:05 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:05 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b6e801-227c-4d41-868b-df106c97182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1206870001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cd4c68-0eca-4650-b430-16b2522c9b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:05Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c557e1-a4eb-4a07-a351-742255b2b12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c557e1-a4eb-4a07-a351-742255b2b12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92094b20-277a-4e82-a09c-d8d99d007bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:05 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92094b20-277a-4e82-a09c-d8d99d007bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24cd4c68-0eca-4650-b430-16b2522c9b4a', 'volume_name': 'volume-24cd4c68-0eca-4650-b430-16b2522c9b4a', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a8e421-5c92-4cc6-9156-5f15e696e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a8e421-5c92-4cc6-9156-5f15e696e877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:05 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78327790-eb13-4a32-87b7-4c1610d455b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:05 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume 24cd4c68-0eca-4650-b430-16b2522c9b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24cd4c68-0eca-4650-b430-16b2522c9b4a', 'volume_size': 1} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.938s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-79a8719e-fbcb-40cd-b4dd-37e19c872e87" returned: 0 in 0.999s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:05 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Deleted volume successfully. Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-79a8719e-fbcb-40cd-b4dd-37e19c872e87" released by "delete_volume" :: held 2.356s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1581c521-1167-416e-b268-4683aa05e262 tempest-ProjectReaderTests-82563222 None] Lock "cinder-99a5ae83-14ae-4fa3-852f-8a12af1bcbf3-delete_volume" released by "delete_volume" :: held 3.683s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Created reservations ['97f9f087-650e-4e0a-ac07-4c5e0ddab065', '649e868a-f0aa-47e8-91b3-d1f2e024446a', 'bd5635cc-6f53-4140-9eb6-d956cff94e1e', 'c2ad18c8-2d5a-4d1c-830b-ba17422ea7bf'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:05 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db" returned: 0 in 1.020s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] <== create_volume: return (2579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.582s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.604s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1764184714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efb460d-9a27-4c2a-a13d-de268edfbfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:04Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Creating volume 7efb460d-9a27-4c2a-a13d-de268edfbfb2 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:05 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:05 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2 1073741824 Jul 05 02:58:05 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e43bc00-dcc3-4f35-a518-614a56d2b28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbe6514-24ae-4a46-b477-95e7e06e61db', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50326336-cef3-46da-b010-af8b868380de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:05 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Volume volume-2dbe6514-24ae-4a46-b477-95e7e06e61db (2dbe6514-24ae-4a46-b477-95e7e06e61db): created successfully Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50326336-cef3-46da-b010-af8b868380de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Flow 'volume_create_manager' (1ce2f09c-2b5c-45be-ad19-ca6374fe1df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:05 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-69e7ad33-26a4-4e97-8a10-f304ae6de4b7 tempest-CinderUnicodeTest-1875489186 None] Created volume successfully. Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (2948cd57-1061-4381-883a-f15787fe95cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f8ad0d-d18b-4c0b-99f5-a8b595372b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f8ad0d-d18b-4c0b-99f5-a8b595372b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-100079414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:06Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ca7bfc-cd35-4c48-9ed2-f74d904bb1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ca7bfc-cd35-4c48-9ed2-f74d904bb1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93fbb3e-69bd-4f08-8c06-806432f65c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93fbb3e-69bd-4f08-8c06-806432f65c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c', 'volume_name': 'volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15788c3d-2024-4faa-8dd0-8a98250672c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15788c3d-2024-4faa-8dd0-8a98250672c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7754b7c-54b3-4270-aab0-befa1ede0835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:06 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume 8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c', 'volume_size': 1} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:06 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:06 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:06 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.832s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (b3725ccc-8ed1-4f88-9703-89607bfc4337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14294000-39bb-4968-9ca5-35990576098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14294000-39bb-4968-9ca5-35990576098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-38193710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c03af7-3e6d-41ef-a6cf-88c10d475ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:06Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b459ac0-ef12-455e-83ea-9b80618a1de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b459ac0-ef12-455e-83ea-9b80618a1de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3afb827-e982-4d06-8d5e-2bc1571ef858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3afb827-e982-4d06-8d5e-2bc1571ef858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c03af7-3e6d-41ef-a6cf-88c10d475ae0', 'volume_name': 'volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed80f4be-9547-486f-adc4-573a21c3b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed80f4be-9547-486f-adc4-573a21c3b74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e449fb8a-cd00-4853-9304-e4ea6bbdd6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:06 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Volume 78c03af7-3e6d-41ef-a6cf-88c10d475ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0', 'volume_size': 1} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-e17f4399-a845-415c-be80-6f2181866644-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-e17f4399-a845-415c-be80-6f2181866644-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-quobyte-e17f4399-a845-415c-be80-6f2181866644" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-e17f4399-a845-415c-be80-6f2181866644" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2a409d-8aff-4505-a47f-c503d51b4605]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:06 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644 Jul 05 02:58:06 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:06 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.817s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:06 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Deleted volume successfully. Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2a1d8c71-7b5e-47ba-97bd-18338f296ddc tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-79a8719e-fbcb-40cd-b4dd-37e19c872e87-delete_volume" released by "delete_volume" :: held 3.778s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:06 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2 1073741824" returned: 0 in 1.201s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Flow 'volume_create_manager' (d6bc6003-3987-4b02-8153-c6f13dffd946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd79fce-7ba5-419b-b9fa-329b65c081c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd79fce-7ba5-419b-b9fa-329b65c081c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1562534259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350bc179-565a-4db7-bb34-252e7099e8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b6c53db23644fd844ed01c85115e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:07Z,use_quota=True,user_id='32f59313908545d7a9baef62b44f8370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:07 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2 Jul 05 02:58:07 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d2a6da-7557-40ae-926d-7e95d727fbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d2a6da-7557-40ae-926d-7e95d727fbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04593223-927e-40a5-b413-bb10dccc3a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04593223-927e-40a5-b413-bb10dccc3a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '350bc179-565a-4db7-bb34-252e7099e8bc', 'volume_name': 'volume-350bc179-565a-4db7-bb34-252e7099e8bc', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09efb3e-1813-4730-96aa-18d23d375634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09efb3e-1813-4730-96aa-18d23d375634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517752af-a6cc-4db3-8b44-6511d4597b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:07 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Volume 350bc179-565a-4db7-bb34-252e7099e8bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-350bc179-565a-4db7-bb34-252e7099e8bc', 'volume_size': 1} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:07 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644" returned: 0 in 0.849s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:07 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644 Jul 05 02:58:07 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:07 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2" returned: 0 in 0.649s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.211s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1374869970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7698854c-734b-4c02-b6eb-ae1b813c5b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:04Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Creating volume 7698854c-734b-4c02-b6eb-ae1b813c5b54 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:07 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3991bf-5c69-4dee-90c2-4a704993a24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b93f3d-982d-4c4f-a204-8c4ef8acda9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:07 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54 1073741824 Jul 05 02:58:07 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:07 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2 (7efb460d-9a27-4c2a-a13d-de268edfbfb2): created successfully Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b93f3d-982d-4c4f-a204-8c4ef8acda9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (85a6d258-0640-4d56-ba6d-0a812f7e692f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a1d21d9c-7ed3-43ab-9f86-28a493c3fc51 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created volume successfully. Jul 05 02:58:08 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-e17f4399-a845-415c-be80-6f2181866644" returned: 0 in 0.693s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-e17f4399-a845-415c-be80-6f2181866644" released by "delete_volume" :: held 1.586s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Created reservations ['aee7e214-b8f7-4a29-9ab6-169138060193', 'cd967ec1-07f9-4040-a82b-1baee268bdea', '3d502ce1-1262-46dd-a563-9a9b3afc39a7', 'fbefad61-a525-456c-97a0-989b50e0e473'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:08 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:08 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:08 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54 1073741824" returned: 0 in 0.841s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:08 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54 Jul 05 02:58:08 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-quobyte-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb50e865-7549-4a9f-bbff-b26fb87e0e3c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:08 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa Jul 05 02:58:08 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:09 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.726s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:09 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Deleted volume successfully. Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-177dcfb8-57e8-4f9c-8fe8-60862aa90cb5 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-e17f4399-a845-415c-be80-6f2181866644-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:09 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54" returned: 0 in 0.690s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.497s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-697536740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdc2f7b-5ada-4c02-8cdc-4881305b9763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:05Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Creating volume 6bdc2f7b-5ada-4c02-8cdc-4881305b9763 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:09 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90e2d7e-7e82-4338-863a-5c706603612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7698854c-734b-4c02-b6eb-ae1b813c5b54', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a43dc50-3f9a-4693-b36c-890678c02cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:09 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763 1073741824 Jul 05 02:58:09 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:09 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume volume-7698854c-734b-4c02-b6eb-ae1b813c5b54 (7698854c-734b-4c02-b6eb-ae1b813c5b54): created successfully Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a43dc50-3f9a-4693-b36c-890678c02cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (bdd48534-1d41-4c4f-a34c-b304ce942b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:09 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4d418069-14d2-49ea-83f5-f55bcd34f80e tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created volume successfully. Jul 05 02:58:09 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa" returned: 0 in 0.804s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:09 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa Jul 05 02:58:09 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:10 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763 1073741824" returned: 0 in 0.850s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:10 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763 Jul 05 02:58:10 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:10 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa" returned: 0 in 0.679s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa" released by "delete_volume" :: held 1.533s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Created reservations ['50bc1c66-9a44-47f1-a00f-f3cbd2768fb4', 'e6900085-f35c-4ff6-9cbf-879b5145e2e1', '97423724-9a2a-44b8-8bbc-c28c17fb8a2c', 'a3e66945-745b-48d4-a10d-86f92665cb86'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:10 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:10 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:10 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763" returned: 0 in 0.684s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.358s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1206870001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24cd4c68-0eca-4650-b430-16b2522c9b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:05Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Creating volume 24cd4c68-0eca-4650-b430-16b2522c9b4a {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:10 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801c9c0a-5330-4e08-b315-d4b904276518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80684dcb-ef29-4745-b4c9-24184f75f2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:10 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a 1073741824 Jul 05 02:58:10 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-dadef929-f795-479e-a600-fe321b5378e2-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763 (6bdc2f7b-5ada-4c02-8cdc-4881305b9763): created successfully Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80684dcb-ef29-4745-b4c9-24184f75f2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (36c2a500-94ab-4aa7-b907-ca6ed9995ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-dadef929-f795-479e-a600-fe321b5378e2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-19502383-fe82-4a54-924f-90c2ff03006a tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created volume successfully. Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-quobyte-dadef929-f795-479e-a600-fe321b5378e2" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-dadef929-f795-479e-a600-fe321b5378e2" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e260217-6bbe-457a-b032-3eaad3d322e4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:11 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.710s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Deleted volume successfully. Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-748ab97d-a6a2-4100-ba16-ac0d214356de tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-2756a2bd-125d-4739-bbf5-8f4bb26a9aaa-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:11 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2 Jul 05 02:58:11 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:11 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a 1073741824" returned: 0 in 0.870s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:11 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a Jul 05 02:58:11 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:11 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2" returned: 0 in 0.794s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:11 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2 Jul 05 02:58:11 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:12 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a" returned: 0 in 0.664s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.482s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-100079414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a61742430f9b4bf9aae6c0d9b38bc49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:06Z,use_quota=True,user_id='ecdd4ff9ca0a43238fad27450ee5a109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Creating volume 8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:12 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78327790-eb13-4a32-87b7-4c1610d455b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24cd4c68-0eca-4650-b430-16b2522c9b4a', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:12 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c 1073741824 Jul 05 02:58:12 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ddc2ad-b02a-4525-a560-500227cb908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:12 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume volume-24cd4c68-0eca-4650-b430-16b2522c9b4a (24cd4c68-0eca-4650-b430-16b2522c9b4a): created successfully Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ddc2ad-b02a-4525-a560-500227cb908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:12 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (6920003f-2ba6-4a37-b59c-0c978755b998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-dadef929-f795-479e-a600-fe321b5378e2" returned: 0 in 0.655s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:12 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-37e5b4b6-ae71-4c6e-bb52-d19e80cb7b0f tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created volume successfully. Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-dadef929-f795-479e-a600-fe321b5378e2" released by "delete_volume" :: held 1.500s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Created reservations ['a6da0f3b-e74d-40c0-9ec0-3fec570556c1', '949955fc-3011-4e2f-83b8-5a976aa0638a', '0c96486f-dc86-46c2-9dca-5a0b34975dd3', 'd963ca89-c17a-4931-9624-0b2f846e4183'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:12 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:12 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-a04ec9e4-c8f2-478e-ab56-53921d5d48e4-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-a04ec9e4-c8f2-478e-ab56-53921d5d48e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-quobyte-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-quobyte-a04ec9e4-c8f2-478e-ab56-53921d5d48e4" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-a04ec9e4-c8f2-478e-ab56-53921d5d48e4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Deleting offline snapshot a04ec9e4-c8f2-478e-ab56-53921d5d48e4 of volume b81fb7b8-62e4-47f4-81e4-c6c11b349e53 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] snapshot_file for this snap is: volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b09fc9-a536-47c8-964e-08f042febfa2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:13 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 Jul 05 02:58:13 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:13 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.699s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:13 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Deleted volume successfully. Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c 1073741824" returned: 0 in 0.932s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffa22ad0-ee36-4379-ae58-b173ad2f9bca tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-dadef929-f795-479e-a600-fe321b5378e2-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:13 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c Jul 05 02:58:13 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:14 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4" returned: 0 in 0.773s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdbdc4a-d19a-4ed6-bf3b-dfefadfc62ba]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:14 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c" returned: 0 in 0.628s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.622s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-38193710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c03af7-3e6d-41ef-a6cf-88c10d475ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:06Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Creating volume 78c03af7-3e6d-41ef-a6cf-88c10d475ae0 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:14 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:14 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 1073741824 Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7754b7c-54b3-4270-aab0-befa1ede0835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:14 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3234c85-7171-4ed0-8680-642ac9f61cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:14 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Volume volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c (8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c): created successfully Jul 05 02:58:14 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 Jul 05 02:58:14 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3234c85-7171-4ed0-8680-642ac9f61cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Flow 'volume_create_manager' (2948cd57-1061-4381-883a-f15787fe95cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:14 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-95674654-2648-4a59-8356-1c8f5e19ab87 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created volume successfully. Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-quobyte-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6680fdc7-56dc-4526-837a-0a783a0fb6be]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:14 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" returned: 0 in 0.779s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:14 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 Jul 05 02:58:14 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:14 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c Jul 05 02:58:14 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:15 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 1073741824" returned: 0 in 0.923s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:15 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 Jul 05 02:58:15 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:15 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c" returned: 0 in 0.805s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:15 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c Jul 05 02:58:15 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:15 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4" returned: 0 in 0.785s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:15 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4 Jul 05 02:58:15 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:15 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" returned: 0 in 0.689s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.679s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1562534259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350bc179-565a-4db7-bb34-252e7099e8bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b6c53db23644fd844ed01c85115e92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:07Z,use_quota=True,user_id='32f59313908545d7a9baef62b44f8370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Creating volume 350bc179-565a-4db7-bb34-252e7099e8bc {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:15 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:15 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc 1073741824 Jul 05 02:58:15 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e449fb8a-cd00-4853-9304-e4ea6bbdd6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb27fbf-3ba9-4b48-ac54-f40cec05b6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:15 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Volume volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 (78c03af7-3e6d-41ef-a6cf-88c10d475ae0): created successfully Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb27fbf-3ba9-4b48-ac54-f40cec05b6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:15 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (b3725ccc-8ed1-4f88-9703-89607bfc4337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:15 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a6a40191-92a5-49a7-934c-e34b39436af3 tempest-ProjectReaderTests-82563222 None] Created volume successfully. Jul 05 02:58:16 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c" returned: 0 in 0.687s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c" released by "delete_volume" :: held 1.551s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:16 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53.a04ec9e4-c8f2-478e-ab56-53921d5d48e4" returned: 0 in 0.679s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-a04ec9e4-c8f2-478e-ab56-53921d5d48e4" released by "_delete_snapshot" :: held 3.125s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" released by "delete_snapshot" :: held 3.150s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created reservations ['714afc2a-e6a7-46a6-8aea-a8b3e25a010a', '1610a53a-4fbc-4fa0-9bc4-79035b387d09', '65599c56-1c9c-47c8-ab51-fa5af23d73b2', '3e5a61ef-0641-4d12-b2e6-f46b6d15e79f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Created reservations ['40e79f76-e7d5-47d3-9400-df35172db430', 'cb1bce8a-fb74-41b5-9874-fa8f7e4b4866', '0b5b7a36-9745-43f4-8a0c-ed1f6c074b03', '105b3d62-c424-467e-8328-ac2d3a82cd4c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:16 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:16 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:16 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Delete snapshot completed successfully. Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-191ce0ed-e115-4ada-84fa-0bb093200184 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-a04ec9e4-c8f2-478e-ab56-53921d5d48e4-delete_snapshot" released by "delete_snapshot" :: held 3.377s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:16 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc 1073741824" returned: 0 in 0.922s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:16 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc Jul 05 02:58:16 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-24cd4c68-0eca-4650-b430-16b2522c9b4a-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-24cd4c68-0eca-4650-b430-16b2522c9b4a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-quobyte-24cd4c68-0eca-4650-b430-16b2522c9b4a" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-24cd4c68-0eca-4650-b430-16b2522c9b4a" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efdfe3c-3bef-4372-9e0e-3cf6fe260fea]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:17 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a Jul 05 02:58:17 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:17 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.785s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:17 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Deleted volume successfully. Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-84b0bab3-7e9b-478d-9ac3-094d05ddf28c tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-8f4ef6a0-7f17-47f0-b49d-eebf7aa3e57c-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-b81fb7b8-62e4-47f4-81e4-c6c11b349e53-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-b81fb7b8-62e4-47f4-81e4-c6c11b349e53-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "cinder-quobyte-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:17 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc" returned: 0 in 0.788s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.333s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4c0fa4-eee8-4e72-9582-3b0e6a7dac62]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Creating offline snapshot 12c1919b-88b8-4d52-93d9-26d96a1ab4d0 of volume 78c03af7-3e6d-41ef-a6cf-88c10d475ae0 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517752af-a6cc-4db3-8b44-6511d4597b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-350bc179-565a-4db7-bb34-252e7099e8bc', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d4a26d-9bf0-4871-9016-dd1d7ac39d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c5f7ba-18b9-478f-983b-6886caa5ee9c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:17 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Volume volume-350bc179-565a-4db7-bb34-252e7099e8bc (350bc179-565a-4db7-bb34-252e7099e8bc): created successfully Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d4a26d-9bf0-4871-9016-dd1d7ac39d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Flow 'volume_create_manager' (d6bc6003-3987-4b02-8153-c6f13dffd946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:17 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8b50fae4-3e59-4eb0-acaf-e48aa838908a tempest-CinderUnicodeTest-1875489186 None] Created volume successfully. Jul 05 02:58:17 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 Jul 05 02:58:17 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:17 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 Jul 05 02:58:17 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:17 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a" returned: 0 in 0.866s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:17 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a Jul 05 02:58:17 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:18 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" returned: 0 in 0.831s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:18 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53 Jul 05 02:58:18 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:18 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" returned: 0 in 0.864s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:18 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 1G Jul 05 02:58:18 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:18 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-24cd4c68-0eca-4650-b430-16b2522c9b4a" returned: 0 in 0.663s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-24cd4c68-0eca-4650-b430-16b2522c9b4a" released by "delete_volume" :: held 1.581s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created reservations ['a818ba67-0937-4548-a56e-1811fff8579f', 'acb67a79-de01-4b12-8e05-cf9991fbe77b', '18add7c5-e7be-486f-a537-218d6cfb70f0', 'c752172d-c332-4a3a-8323-7195a175a8ed'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:18 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:18 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:19 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" returned: 0 in 0.754s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-quobyte-b81fb7b8-62e4-47f4-81e4-c6c11b349e53" released by "delete_volume" :: held 1.663s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-6bdc2f7b-5ada-4c02-8cdc-4881305b9763-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-6bdc2f7b-5ada-4c02-8cdc-4881305b9763-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Created reservations ['790828f4-7e83-4f7e-8e0e-b70e01374da8', '9e894b75-155e-47c9-b4d3-6b3e1826a52d', '705b1247-2263-4fe0-9ef1-5fcb3b3af4c9', '0edcdafc-c6c9-435b-ab7a-5a984bac7b21'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-quobyte-6bdc2f7b-5ada-4c02-8cdc-4881305b9763" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-6bdc2f7b-5ada-4c02-8cdc-4881305b9763" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e10c9b-fece-49d5-be2e-e9dc8b8c2ed4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:19 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:19 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:19 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 1G" returned: 0 in 0.985s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:19 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763 Jul 05 02:58:19 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:19 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 Jul 05 02:58:19 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:19 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.819s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:19 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Deleted volume successfully. Jul 05 02:58:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d4f1fb44-12fc-45ac-ac6b-635797b05e19 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-24cd4c68-0eca-4650-b430-16b2522c9b4a-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:20 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.721s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:20 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Deleted volume successfully. Jul 05 02:58:20 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c1187049-51fb-4a1e-9710-ac85f90b3371 tempest-CreateVolumesFromSnapshotTest-850428987 None] Lock "cinder-b81fb7b8-62e4-47f4-81e4-c6c11b349e53-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:20 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763" returned: 0 in 0.863s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:20 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763 Jul 05 02:58:20 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:20 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0" returned: 0 in 0.800s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:20 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 is being set with open permissions: ugo+rw Jul 05 02:58:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:20 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 Jul 05 02:58:20 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6bdc2f7b-5ada-4c02-8cdc-4881305b9763" returned: 0 in 0.720s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:20 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-6bdc2f7b-5ada-4c02-8cdc-4881305b9763" released by "delete_volume" :: held 1.632s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created reservations ['9e5b1512-2513-4e1d-9565-dade2ba36a4c', 'a5d3cfc4-b7e4-4a45-b4ea-f78bd2da4b57', 'f60dfc0a-4570-40d7-a500-d10d3229190f', '2499bdbd-5853-4337-8525-bfd542bf4b6c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:21 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0" returned: 0 in 0.787s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:21 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.info Jul 05 02:58:21 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:21 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:21 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-7698854c-734b-4c02-b6eb-ae1b813c5b54-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-7698854c-734b-4c02-b6eb-ae1b813c5b54-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-quobyte-7698854c-734b-4c02-b6eb-ae1b813c5b54" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-7698854c-734b-4c02-b6eb-ae1b813c5b54" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd37331b-2df3-4635-a23c-9e65e81159c5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:21 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54 Jul 05 02:58:21 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:21 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.info" returned: 0 in 0.781s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:21 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.info is being set with open permissions: ugo+rw Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:21 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.info Jul 05 02:58:21 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:21 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.794s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:21 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Deleted volume successfully. Jul 05 02:58:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d47dedf1-d9b4-453e-b776-e39deb164ac2 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-6bdc2f7b-5ada-4c02-8cdc-4881305b9763-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:22 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54" returned: 0 in 0.839s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:22 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54 Jul 05 02:58:22 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:22 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.info" returned: 0 in 0.685s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.033s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.495s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:22 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Creating offline snapshot c4e267c1-10c3-43d0-a69b-83aaad10a8d6 of volume 350bc179-565a-4db7-bb34-252e7099e8bc {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:58:22 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c68cf93f-ac48-4852-b150-1a2dd450b26b tempest-ProjectReaderTests-82563222 None] Create snapshot completed successfully Jul 05 02:58:22 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe35b0f-4e36-4882-b6da-91f40af57ede]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:22 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc Jul 05 02:58:22 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:23 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7698854c-734b-4c02-b6eb-ae1b813c5b54" returned: 0 in 0.660s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-7698854c-734b-4c02-b6eb-ae1b813c5b54" released by "delete_volume" :: held 1.552s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created reservations ['95468c98-e60a-42ae-b7e9-2f8a285fa30e', '42bf278c-2f11-4dbf-b707-ab5d0e9f5f4b', '0fc93743-6108-4e5b-b1cb-d5217a119616', '7208a50c-cfed-40b5-bc86-534da21ce125'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:23 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:23 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:23 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc" returned: 0 in 0.837s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:23 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 1G Jul 05 02:58:23 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-12c1919b-88b8-4d52-93d9-26d96a1ab4d0-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Lock "cinder-12c1919b-88b8-4d52-93d9-26d96a1ab4d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-12c1919b-88b8-4d52-93d9-26d96a1ab4d0" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-12c1919b-88b8-4d52-93d9-26d96a1ab4d0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Deleting offline snapshot 12c1919b-88b8-4d52-93d9-26d96a1ab4d0 of volume 78c03af7-3e6d-41ef-a6cf-88c10d475ae0 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] snapshot_file for this snap is: volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b64b53c-36c5-44a2-beb1-1c1cfb4377bd]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-7efb460d-9a27-4c2a-a13d-de268edfbfb2-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-7efb460d-9a27-4c2a-a13d-de268edfbfb2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:23 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-quobyte-7efb460d-9a27-4c2a-a13d-de268edfbfb2" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:23 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-7efb460d-9a27-4c2a-a13d-de268edfbfb2" acquired by "delete_volume" :: waited 0.029s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ea1110-5e5a-4f31-9676-ab0f427e5acf]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:24 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.785s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Deleted volume successfully. Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7f2eb48f-299f-4771-8eae-2ab65784f1e1 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-7698854c-734b-4c02-b6eb-ae1b813c5b54-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:24 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2 Jul 05 02:58:24 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:24 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 1G" returned: 0 in 1.071s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350bc179-565a-4db7-bb34-252e7099e8bc -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:24 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350bc179-565a-4db7-bb34-252e7099e8bc -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 Jul 05 02:58:24 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:24 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0" returned: 0 in 0.988s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd56437-38f5-43ff-9da9-ca3bbec35bee]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:24 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 Jul 05 02:58:24 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:25 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2" returned: 0 in 0.991s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:25 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2 Jul 05 02:58:25 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:25 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350bc179-565a-4db7-bb34-252e7099e8bc -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6" returned: 0 in 0.868s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:25 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 is being set with open permissions: ugo+rw Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:25 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 Jul 05 02:58:25 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Flow 'volume_create_manager' (0253059a-709e-470f-939c-c7dce59827fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b11635-467d-4acf-8e4a-5836ecc30a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=159,cinder:UPDATE=235,cinder:DELETE=16,cinder:INSERT=51 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b11635-467d-4acf-8e4a-5836ecc30a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8535b7d1-663b-413e-8dc1-07388ea60523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43bfda2487144d26bf0ef1083a38ee59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:26Z,use_quota=True,user_id='728a83d7f02841bc9a73cda2d2163847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422aa5d8-fb14-437d-bf9b-85dddd836e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422aa5d8-fb14-437d-bf9b-85dddd836e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0dc735-09bf-4f34-af7b-6556d2ec47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.image.glance [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Creating Keystone auth plugin from conf {{(pid=86671) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 02:58:25 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" returned: 0 in 1.010s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:25 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 Jul 05 02:58:25 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:25 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7efb460d-9a27-4c2a-a13d-de268edfbfb2" returned: 0 in 0.802s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-7efb460d-9a27-4c2a-a13d-de268edfbfb2" released by "delete_volume" :: held 1.862s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created reservations ['f50f01cd-07ad-41da-862a-ac7544a98cdf', 'd8ff4870-c000-4b49-83ad-54d98d87c108', '5acf53e7-15be-49ce-b4c8-28c5d0e8871b', '36ad07a6-070c-4e10-8e50-ce5e4171335a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0dc735-09bf-4f34-af7b-6556d2ec47e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8535b7d1-663b-413e-8dc1-07388ea60523', 'volume_name': 'volume-8535b7d1-663b-413e-8dc1-07388ea60523', 'volume_size': 1, 'image_id': '8f9b43db-ab5f-470f-b52e-02c849717137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f9b43db-ab5f-470f-b52e-02c849717137', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a390e6cf73d8adbc725985435ed0645', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43bfda2487144d26bf0ef1083a38ee59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b3964c309f09be374211cbcfcee22d1eb844a1cc0518722162483bfd7f4e9537b5df47aab7bb1c9ea0c9b6667e80cf5895dd8add87af62eb82d877f9bc6c9f52', 'id': '8f9b43db-ab5f-470f-b52e-02c849717137', 'created_at': datetime.datetime(2026, 7, 5, 0, 58, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 58, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f9b43db-ab5f-470f-b52e-02c849717137/file', 'properties': {}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c258ea-c601-447a-b6fb-238e617891da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c258ea-c601-447a-b6fb-238e617891da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2609a24d-f311-4f29-8a2d-63849fca4bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:25 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Volume 8535b7d1-663b-413e-8dc1-07388ea60523: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8535b7d1-663b-413e-8dc1-07388ea60523', 'volume_size': 1, 'image_id': '8f9b43db-ab5f-470f-b52e-02c849717137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f9b43db-ab5f-470f-b52e-02c849717137', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a390e6cf73d8adbc725985435ed0645', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43bfda2487144d26bf0ef1083a38ee59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b3964c309f09be374211cbcfcee22d1eb844a1cc0518722162483bfd7f4e9537b5df47aab7bb1c9ea0c9b6667e80cf5895dd8add87af62eb82d877f9bc6c9f52', 'id': '8f9b43db-ab5f-470f-b52e-02c849717137', 'created_at': datetime.datetime(2026, 7, 5, 0, 58, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 58, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f9b43db-ab5f-470f-b52e-02c849717137/file', 'properties': {}}, 'image_service': } Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Trying to clone 8535b7d1-663b-413e-8dc1-07388ea60523 from image 8f9b43db-ab5f-470f-b52e-02c849717137 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8f9b43db-ab5f-470f-b52e-02c849717137', 'metadata': {}}]). {{(pid=86671) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 05 02:58:25 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=157,cinder:UPDATE=212,cinder:INSERT=62,cinder:DELETE=26 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:26 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:26 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 02:58:26 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Image download 0.00 MB at 0.00 MB/s Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-abdaebe6-0bf4-4098-b8ad-1e58217bea55-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-abdaebe6-0bf4-4098-b8ad-1e58217bea55-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5d5bf0-1888-4ab2-8231-a1a7b48b4788]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:26 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6" returned: 0 in 0.797s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "cinder-quobyte-abdaebe6-0bf4-4098-b8ad-1e58217bea55" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-abdaebe6-0bf4-4098-b8ad-1e58217bea55" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[20da8255-ba3a-49ef-be80-b5d9d8c92995]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:26 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD Jul 05 02:58:26 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:26 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.info Jul 05 02:58:26 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:26 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55 Jul 05 02:58:26 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:26 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0" returned: 0 in 1.072s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:26 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0 Jul 05 02:58:26 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:27 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD" returned: 0 in 0.887s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:27 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.info" returned: 0 in 0.804s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:27 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.info is being set with open permissions: ugo+rw Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:27 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:27 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.info Jul 05 02:58:27 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.176s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Deleted volume successfully. Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d6d2cd4d-a78e-4faa-9fbe-636b37cf07f9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-7efb460d-9a27-4c2a-a13d-de268edfbfb2-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:27 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD Jul 05 02:58:27 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:27 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55" returned: 0 in 1.041s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:27 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55 Jul 05 02:58:27 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:27 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0.12c1919b-88b8-4d52-93d9-26d96a1ab4d0" returned: 0 in 0.775s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-12c1919b-88b8-4d52-93d9-26d96a1ab4d0" released by "_delete_snapshot" :: held 3.973s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" released by "delete_snapshot" :: held 4.006s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Created reservations ['d8cfa8c0-d765-496c-8cb9-b9a52bc80acf', '5f1e0c58-ccd4-4a11-ac99-2af21a6b8c8b', 'd41823ae-7069-4aac-b87a-5b0ddd5f4ead', '6f2d6712-4f49-4a48-945d-12bcca87d2e0'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Delete snapshot completed successfully. Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e64b15b0-ce6f-4d3b-b1f1-d4d54960c447 tempest-ProjectReaderTests-82563222 None] Lock "cinder-12c1919b-88b8-4d52-93d9-26d96a1ab4d0-delete_snapshot" released by "delete_snapshot" :: held 4.239s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:27 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.info" returned: 0 in 0.794s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.351s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4790deff-dde7-4fa9-aae4-8bda8eb8be2d tempest-CinderUnicodeTest-1875489186 None] Create snapshot completed successfully Jul 05 02:58:28 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD" returned: 1 in 0.923s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Temporary image 8f9b43db-ab5f-470f-b52e-02c849717137 is fetched for user 728a83d7f02841bc9a73cda2d2163847. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 02:58:28 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-abdaebe6-0bf4-4098-b8ad-1e58217bea55" returned: 0 in 0.725s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-quobyte-abdaebe6-0bf4-4098-b8ad-1e58217bea55" released by "delete_volume" :: held 1.818s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d1105a-c731-45da-8d21-2a8cb64d0323]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Created reservations ['8a28cc6d-0d08-4b07-9d80-dd6426b1be74', '35a5a8e0-a20d-4c2a-a352-8489a3b5105d', '28ec52fd-4f58-422c-b7ea-7f8fdc6a61ce', 'a96134c5-2683-4d54-a090-ae3c4d3e6df7'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:28 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:28 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:28 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:28 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "cinder-c4e267c1-10c3-43d0-a69b-83aaad10a8d6-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-c4e267c1-10c3-43d0-a69b-83aaad10a8d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "cinder-quobyte-350bc179-565a-4db7-bb34-252e7099e8bc" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-quobyte-350bc179-565a-4db7-bb34-252e7099e8bc" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "cinder-quobyte-c4e267c1-10c3-43d0-a69b-83aaad10a8d6" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-quobyte-c4e267c1-10c3-43d0-a69b-83aaad10a8d6" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Deleting offline snapshot c4e267c1-10c3-43d0-a69b-83aaad10a8d6 of volume 350bc179-565a-4db7-bb34-252e7099e8bc {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] snapshot_file for this snap is: volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef63eff-0e89-473a-b4e5-ff9724cfd717]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:28 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 Jul 05 02:58:28 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-78c03af7-3e6d-41ef-a6cf-88c10d475ae0-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:28 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Lock "cinder-78c03af7-3e6d-41ef-a6cf-88c10d475ae0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:29 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.870s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:29 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Deleted volume successfully. Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[09289b9f-9d2a-471e-b6dd-23f28996f06f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:29 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD Jul 05 02:58:29 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0ad51aab-3a08-443a-92eb-3fe8c1ccbca9 tempest-CreateVolumesFromSourceVolumeTest-1515744853 None] Lock "cinder-abdaebe6-0bf4-4098-b8ad-1e58217bea55-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:29 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 Jul 05 02:58:29 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:29 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6" returned: 0 in 0.982s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-350bc179-565a-4db7-bb34-252e7099e8bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe8f313-cb13-4d20-b332-b534069fccea]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:29 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD" returned: 1 in 0.900s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:58:29 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:29 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8535b7d1-663b-413e-8dc1-07388ea60523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43bfda2487144d26bf0ef1083a38ee59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:26Z,use_quota=True,user_id='728a83d7f02841bc9a73cda2d2163847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Creating volume 8535b7d1-663b-413e-8dc1-07388ea60523 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:29 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:29 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 1073741824 Jul 05 02:58:29 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:30 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" returned: 0 in 1.069s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:30 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0 Jul 05 02:58:30 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:30 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc" returned: 0 in 0.980s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:30 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 Jul 05 02:58:30 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:30 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 1073741824" returned: 0 in 1.022s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:30 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" returned: 0 in 0.771s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:30 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 Jul 05 02:58:30 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-78c03af7-3e6d-41ef-a6cf-88c10d475ae0" released by "delete_volume" :: held 1.931s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Created reservations ['c6b50a65-8799-438f-a7fe-c46c7e892d9c', '65c437b4-82d2-431b-b5e4-fb1041676a76', '32d1f1a6-7486-43c5-bd8d-e6fd26a79797', 'fc760cf0-05d8-4aa4-aeb7-1c7f0c142ab4'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:31 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:31 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:31 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523" returned: 0 in 0.761s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:31 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Attempting download of 8f9b43db-ab5f-470f-b52e-02c849717137 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f9b43db-ab5f-470f-b52e-02c849717137', 'metadata': {}}])) to volume 8535b7d1-663b-413e-8dc1-07388ea60523. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6" returned: 0 in 1.050s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:31 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6 Jul 05 02:58:31 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc08c40-1023-4901-86bb-4746a6c889e9]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f9b43db-ab5f-470f-b52e-02c849717137_s4ish3pt {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (09b85c31-3ff3-454a-8245-321bd2621c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:32 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f9b43db-ab5f-470f-b52e-02c849717137_s4ish3pt Jul 05 02:58:32 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fed58c7-d49a-4150-bcc7-a36af81b8dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fed58c7-d49a-4150-bcc7-a36af81b8dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863315524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2016b9f-6242-42a5-b135-ebecc5e08d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:32Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde3c676-15a5-4f44-9cf1-64c6bdeb1470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde3c676-15a5-4f44-9cf1-64c6bdeb1470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf08d393-fff5-43a1-a5a5-eaa9f642382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf08d393-fff5-43a1-a5a5-eaa9f642382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2016b9f-6242-42a5-b135-ebecc5e08d36', 'volume_name': 'volume-a2016b9f-6242-42a5-b135-ebecc5e08d36', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6fc804-825a-4c2b-bf90-6051fdbb16f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6fc804-825a-4c2b-bf90-6051fdbb16f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1417ff-8123-4dbb-8192-1e6c12e18441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:32 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Volume a2016b9f-6242-42a5-b135-ebecc5e08d36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2016b9f-6242-42a5-b135-ebecc5e08d36', 'volume_size': 1} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863315524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2016b9f-6242-42a5-b135-ebecc5e08d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:32Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Creating volume a2016b9f-6242-42a5-b135-ebecc5e08d36 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:32 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:32 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 1073741824 Jul 05 02:58:32 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:32 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.061s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Deleted volume successfully. Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-1d120978-f09d-47bc-96dd-a1cbedfa788c tempest-ProjectReaderTests-82563222 None] Lock "cinder-78c03af7-3e6d-41ef-a6cf-88c10d475ae0-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Flow 'volume_create_manager' (5ca3d0ab-985f-443a-900a-8d79d87576c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caad597-fd0d-4654-98c4-732a0205e9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caad597-fd0d-4654-98c4-732a0205e9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-766573736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def48b6f-7a58-4fb3-9d06-6a78ac3d55d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f195f24f9b406f95675cd6113da7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:32Z,use_quota=True,user_id='1af57fd51f9342d89b24884f9541591a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc5355a-490d-48b9-befa-683ba91956af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc5355a-490d-48b9-befa-683ba91956af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fb14f8-34a4-4707-b2bb-3ce4b58c7b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fb14f8-34a4-4707-b2bb-3ce4b58c7b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'def48b6f-7a58-4fb3-9d06-6a78ac3d55d1', 'volume_name': 'volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00579b84-91b7-4c63-a366-5ae5ea34aa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00579b84-91b7-4c63-a366-5ae5ea34aa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bde726-d3d3-45cb-9899-b2e403951917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:32 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Volume def48b6f-7a58-4fb3-9d06-6a78ac3d55d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1', 'volume_size': 1} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:32 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc.c4e267c1-10c3-43d0-a69b-83aaad10a8d6" returned: 0 in 0.997s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:32 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f9b43db-ab5f-470f-b52e-02c849717137_s4ish3pt" returned: 0 in 0.911s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f9b43db-ab5f-470f-b52e-02c849717137_s4ish3pt {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-quobyte-c4e267c1-10c3-43d0-a69b-83aaad10a8d6" released by "_delete_snapshot" :: held 4.159s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-quobyte-350bc179-565a-4db7-bb34-252e7099e8bc" released by "delete_snapshot" :: held 4.210s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:32 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Created reservations ['e61daa19-9538-41dc-afe1-3aaa765bf922', '7821f36c-5637-46c1-8c9d-81dc9c593e7a', '005775cc-089c-4364-8852-9643f3268742', '6ade90ce-eba4-4153-bbd4-16e1e57e5610'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:32 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f9b43db-ab5f-470f-b52e-02c849717137_s4ish3pt Jul 05 02:58:32 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:33 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Delete snapshot completed successfully. Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-2024d5b2-0ac3-4d8d-8a52-c3898a084008 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-c4e267c1-10c3-43d0-a69b-83aaad10a8d6-delete_snapshot" released by "delete_snapshot" :: held 4.401s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:33 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 1073741824" returned: 0 in 1.036s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:33 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 Jul 05 02:58:33 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:33 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f9b43db-ab5f-470f-b52e-02c849717137_s4ish3pt" returned: 1 in 0.767s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f9b43db-ab5f-470f-b52e-02c849717137_s4ish3pt' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f84fbb3-c3c9-4670-b440-fa499bec74e5]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:33 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD Jul 05 02:58:33 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:33 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36" returned: 0 in 0.659s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.435s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-766573736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def48b6f-7a58-4fb3-9d06-6a78ac3d55d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f195f24f9b406f95675cd6113da7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:32Z,use_quota=True,user_id='1af57fd51f9342d89b24884f9541591a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Creating volume def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:33 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:33 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 1073741824 Jul 05 02:58:33 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1417ff-8123-4dbb-8192-1e6c12e18441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2016b9f-6242-42a5-b135-ebecc5e08d36', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c3e652-373a-46e4-90c2-945aa48e4f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "cinder-350bc179-565a-4db7-bb34-252e7099e8bc-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:34 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Volume volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 (a2016b9f-6242-42a5-b135-ebecc5e08d36): created successfully Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c3e652-373a-46e4-90c2-945aa48e4f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (09b85c31-3ff3-454a-8245-321bd2621c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-350bc179-565a-4db7-bb34-252e7099e8bc-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:34 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-23fa26cc-d57b-41d2-afec-4529de003f01 tempest-ProjectReaderTests-82563222 None] Created volume successfully. Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "cinder-quobyte-350bc179-565a-4db7-bb34-252e7099e8bc" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-quobyte-350bc179-565a-4db7-bb34-252e7099e8bc" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93ad158-2562-4800-90e7-7b7bf49bcfdd]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:34 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc Jul 05 02:58:34 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:34 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:34 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD Jul 05 02:58:34 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:34 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 1073741824" returned: 0 in 0.912s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:34 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 Jul 05 02:58:34 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:35 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc" returned: 0 in 0.875s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:35 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc Jul 05 02:58:35 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:35 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD" returned: 1 in 0.793s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] 8f9b43db-ab5f-470f-b52e-02c849717137 was raw, converting to raw {{(pid=86671) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:35 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 Jul 05 02:58:35 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:35 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" returned: 0 in 0.682s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.169s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bde726-d3d3-45cb-9899-b2e403951917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbe3dfb-8c9f-441e-8966-edc0a9154a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Creating offline snapshot d366904f-b5dd-4007-883b-2b648b7775ac of volume a2016b9f-6242-42a5-b135-ebecc5e08d36 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:58:35 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Volume volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 (def48b6f-7a58-4fb3-9d06-6a78ac3d55d1): created successfully Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbe3dfb-8c9f-441e-8966-edc0a9154a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Flow 'volume_create_manager' (5ca3d0ab-985f-443a-900a-8d79d87576c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc200212-c62d-4537-9544-8a2321bc50fc]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-22c25d40-9cfc-4377-983f-92cd9b493a57 tempest-VolumeDependencyTests-358949554 None] Created volume successfully. Jul 05 02:58:35 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 Jul 05 02:58:35 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:35 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-350bc179-565a-4db7-bb34-252e7099e8bc" returned: 0 in 0.713s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-quobyte-350bc179-565a-4db7-bb34-252e7099e8bc" released by "delete_volume" :: held 1.658s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Created reservations ['f6ea5330-4581-416a-88ce-9a628ad91477', '8922c6e9-4c13-43ce-8f6c-86aeec34d654', 'ec490da2-ed32-41bc-95f6-77fe75115f4b', 'bb5e2930-1e13-4ac4-90a1-23c7efeb81d1'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:35 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:35 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:36 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523" returned: 0 in 0.767s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8f9b43db-ab5f-470f-b52e-02c849717137__0wdb6yudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:58:36 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:36 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 1G Jul 05 02:58:36 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "cinder-2dbe6514-24ae-4a46-b477-95e7e06e61db-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-2dbe6514-24ae-4a46-b477-95e7e06e61db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "cinder-quobyte-2dbe6514-24ae-4a46-b477-95e7e06e61db" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-quobyte-2dbe6514-24ae-4a46-b477-95e7e06e61db" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[848b1fe2-a6e2-4c26-9f98-a02146cd6124]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:36 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36" returned: 0 in 0.954s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.d366904f-b5dd-4007-883b-2b648b7775ac 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:36 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db Jul 05 02:58:36 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:36 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.d366904f-b5dd-4007-883b-2b648b7775ac 1G Jul 05 02:58:36 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:36 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.853s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Deleted volume successfully. Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-075b243e-c253-4729-a319-2138f45f7751 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-350bc179-565a-4db7-bb34-252e7099e8bc-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:36 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 1G" returned: 0 in 0.883s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7a25e7-5ee3-4dc9-b792-98c7fa17e055]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:37 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 Jul 05 02:58:37 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:37 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db" returned: 0 in 0.937s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:37 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db Jul 05 02:58:37 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:37 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.d366904f-b5dd-4007-883b-2b648b7775ac 1G" returned: 0 in 0.983s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.d366904f-b5dd-4007-883b-2b648b7775ac {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:37 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.d366904f-b5dd-4007-883b-2b648b7775ac Jul 05 02:58:37 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:37 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523" returned: 0 in 0.798s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:37 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 Jul 05 02:58:37 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:38 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-2dbe6514-24ae-4a46-b477-95e7e06e61db" returned: 0 in 0.677s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-quobyte-2dbe6514-24ae-4a46-b477-95e7e06e61db" released by "delete_volume" :: held 1.697s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Created reservations ['c07dbe9d-93f4-47a6-b6aa-21fa9aa87fe0', '9efc4016-2a56-4b77-81bb-f3a74f569de9', '71633f22-ce61-4806-adfe-12e64e5190fb', 'e7fa63c8-f878-4da8-9c47-5c62a4ba9ae2'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:38 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:38 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:38 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2016b9f-6242-42a5-b135-ebecc5e08d36 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.d366904f-b5dd-4007-883b-2b648b7775ac" returned: 0 in 0.714s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:38 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.d366904f-b5dd-4007-883b-2b648b7775ac is being set with open permissions: ugo+rw Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.d366904f-b5dd-4007-883b-2b648b7775ac {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:38 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.d366904f-b5dd-4007-883b-2b648b7775ac Jul 05 02:58:38 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:38 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523" returned: 1 in 0.801s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Downloaded image 8f9b43db-ab5f-470f-b52e-02c849717137 ((None, [{'url': 'file:///opt/stack/data/glance/images/8f9b43db-ab5f-470f-b52e-02c849717137', 'metadata': {}}])) to volume 8535b7d1-663b-413e-8dc1-07388ea60523 successfully. {{(pid=86671) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Temporary image 8f9b43db-ab5f-470f-b52e-02c849717137 for user 728a83d7f02841bc9a73cda2d2163847 is deleted. {{(pid=86671) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.volume.volume_utils [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Marking volume 8535b7d1-663b-413e-8dc1-07388ea60523 as bootable. {{(pid=86671) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Copying metadata from image 8f9b43db-ab5f-470f-b52e-02c849717137 to 8535b7d1-663b-413e-8dc1-07388ea60523. {{(pid=86671) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Creating volume glance metadata for volume 8535b7d1-663b-413e-8dc1-07388ea60523 backed by image 8f9b43db-ab5f-470f-b52e-02c849717137 with: {'image_id': '8f9b43db-ab5f-470f-b52e-02c849717137', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0a390e6cf73d8adbc725985435ed0645', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86671) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2609a24d-f311-4f29-8a2d-63849fca4bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8535b7d1-663b-413e-8dc1-07388ea60523', 'volume_size': 1, 'image_id': '8f9b43db-ab5f-470f-b52e-02c849717137', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f9b43db-ab5f-470f-b52e-02c849717137', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a390e6cf73d8adbc725985435ed0645', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43bfda2487144d26bf0ef1083a38ee59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b3964c309f09be374211cbcfcee22d1eb844a1cc0518722162483bfd7f4e9537b5df47aab7bb1c9ea0c9b6667e80cf5895dd8add87af62eb82d877f9bc6c9f52', 'id': '8f9b43db-ab5f-470f-b52e-02c849717137', 'created_at': datetime.datetime(2026, 7, 5, 0, 58, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 0, 58, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f9b43db-ab5f-470f-b52e-02c849717137/file', 'properties': {}}, 'image_service': }' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ed0b09-02f7-4acf-a0e4-ded7aec576b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:38 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Volume volume-8535b7d1-663b-413e-8dc1-07388ea60523 (8535b7d1-663b-413e-8dc1-07388ea60523): created successfully Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ed0b09-02f7-4acf-a0e4-ded7aec576b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Flow 'volume_create_manager' (0253059a-709e-470f-939c-c7dce59827fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:38 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-88d02bb7-31b8-4ed4-b29d-7737180dc146 tempest-VolumeImageDependencyTests-1978500519 None] Created volume successfully. Jul 05 02:58:38 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.678s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:38 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Deleted volume successfully. Jul 05 02:58:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d78babfb-e1da-45cc-bbea-d697eb62e0e3 tempest-CinderUnicodeTest-1875489186 None] Lock "cinder-2dbe6514-24ae-4a46-b477-95e7e06e61db-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:39 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.d366904f-b5dd-4007-883b-2b648b7775ac" returned: 0 in 0.789s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:39 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.info Jul 05 02:58:39 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Acquiring lock "cinder-8535b7d1-663b-413e-8dc1-07388ea60523-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Lock "cinder-8535b7d1-663b-413e-8dc1-07388ea60523-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Acquiring lock "cinder-quobyte-8535b7d1-663b-413e-8dc1-07388ea60523" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Lock "cinder-quobyte-8535b7d1-663b-413e-8dc1-07388ea60523" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:39 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.info" returned: 0 in 0.769s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:39 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.info is being set with open permissions: ugo+rw Jul 05 02:58:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:39 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.info Jul 05 02:58:39 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:39 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e63ec13-78ab-4b19-ab60-f9337ee94da4]: (4, 'raw') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:40 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 Jul 05 02:58:40 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:40 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-a2016b9f-6242-42a5-b135-ebecc5e08d36.info" returned: 0 in 0.662s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.709s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Creating offline snapshot 4899baad-18d0-41c7-a16f-0fcf44028b96 of volume def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:58:40 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[93356372-6682-4048-8f03-4bf6ce3e1e32]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-20d36c20-adc0-4ece-bcd4-02fbe6eef8f8 tempest-ProjectReaderTests-82563222 None] Create snapshot completed successfully Jul 05 02:58:40 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523" returned: 0 in 0.802s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:40 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 Jul 05 02:58:40 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:40 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 Jul 05 02:58:40 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:41 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" returned: 0 in 0.793s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:41 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 1G Jul 05 02:58:41 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:41 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523" returned: 1 in 0.821s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523' failed. Not Retrying. {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 02:58:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:41 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523 Jul 05 02:58:41 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8520dfe0-6e1e-4152-b2e0-3399d01e4701 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-d366904f-b5dd-4007-883b-2b648b7775ac-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8520dfe0-6e1e-4152-b2e0-3399d01e4701 tempest-ProjectReaderTests-82563222 None] Lock "cinder-d366904f-b5dd-4007-883b-2b648b7775ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:41 devstack cinder-volume[86671]: INFO cinder.message.api [None req-8520dfe0-6e1e-4152-b2e0-3399d01e4701 tempest-ProjectReaderTests-82563222 None] Creating message record for request_id = req-8520dfe0-6e1e-4152-b2e0-3399d01e4701 Jul 05 02:58:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8520dfe0-6e1e-4152-b2e0-3399d01e4701 tempest-ProjectReaderTests-82563222 None] Lock "cinder-d366904f-b5dd-4007-883b-2b648b7775ac-delete_snapshot" released by "delete_snapshot" :: held 0.053s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server [None req-8520dfe0-6e1e-4152-b2e0-3399d01e4701 tempest-ProjectReaderTests-82563222 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 221, in wrapper Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1353, in delete_snapshot Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1337, in delete_snapshot Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 02:58:41 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server Jul 05 02:58:42 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8535b7d1-663b-413e-8dc1-07388ea60523" returned: 0 in 0.770s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Lock "cinder-quobyte-8535b7d1-663b-413e-8dc1-07388ea60523" released by "delete_volume" :: held 2.497s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:42 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 1G" returned: 0 in 0.988s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Created reservations ['688ed242-75ad-4e54-931d-83998b4f7b35', 'b97b663a-ea1d-4e19-aa84-59b9001139e5', 'aaa81555-3759-4ae7-9e8f-3dcdd1679a4d', '63d616f1-14ec-4dab-935e-784d953e663d'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:58:42 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 Jul 05 02:58:42 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:42 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:58:42 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:43 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96" returned: 0 in 0.699s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:43 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 is being set with open permissions: ugo+rw Jul 05 02:58:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:43 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 Jul 05 02:58:43 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:43 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.653s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:43 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:58:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Deleted volume successfully. Jul 05 02:58:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-82134c5e-8b2e-4d2f-b57c-ccc3b6e55349 tempest-VolumeImageDependencyTests-1978500519 None] Lock "cinder-8535b7d1-663b-413e-8dc1-07388ea60523-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:43 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96" returned: 0 in 0.701s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:43 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.info Jul 05 02:58:43 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:44 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.info" returned: 0 in 0.749s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:44 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.info is being set with open permissions: ugo+rw Jul 05 02:58:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:44 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.info Jul 05 02:58:44 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:45 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.info" returned: 0 in 0.710s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.759s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f7594a60-b6e0-4075-bdc1-2e001684b56a tempest-VolumeDependencyTests-358949554 None] Create snapshot completed successfully Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Flow 'volume_create_manager' (f23d037f-573f-4cea-b843-bf8aaa2fcc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7edd8b2a-b3a1-4815-8e74-6db0bc99b0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7edd8b2a-b3a1-4815-8e74-6db0bc99b0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-538274606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8823c6a0-b368-4c48-a660-14afcb3879f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f195f24f9b406f95675cd6113da7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4899baad-18d0-41c7-a16f-0fcf44028b96,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:58:47Z,use_quota=True,user_id='1af57fd51f9342d89b24884f9541591a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f869a6c-50a1-4b39-be6f-652a4ef1ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f869a6c-50a1-4b39-be6f-652a4ef1ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c11ea9-26c0-44b8-8ac4-27fffd9c65a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c11ea9-26c0-44b8-8ac4-27fffd9c65a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8823c6a0-b368-4c48-a660-14afcb3879f0', 'volume_name': 'volume-8823c6a0-b368-4c48-a660-14afcb3879f0', 'volume_size': 1, 'snapshot_id': '4899baad-18d0-41c7-a16f-0fcf44028b96'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab9c6e8-2939-4540-9ae9-7a9b4d6f5a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab9c6e8-2939-4540-9ae9-7a9b4d6f5a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47933e2-9918-40ee-952f-ca98849add05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:46 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Volume 8823c6a0-b368-4c48-a660-14afcb3879f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8823c6a0-b368-4c48-a660-14afcb3879f0', 'volume_size': 1, 'snapshot_id': '4899baad-18d0-41c7-a16f-0fcf44028b96'} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Acquiring lock "cinder-quobyte-4899baad-18d0-41c7-a16f-0fcf44028b96-8823c6a0-b368-4c48-a660-14afcb3879f0" by "_create_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-4899baad-18d0-41c7-a16f-0fcf44028b96-8823c6a0-b368-4c48-a660-14afcb3879f0" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Creating volume 8823c6a0-b368-4c48-a660-14afcb3879f0 from snapshot 4899baad-18d0-41c7-a16f-0fcf44028b96 {{(pid=86671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Acquiring lock "cinder-quobyte-8823c6a0-b368-4c48-a660-14afcb3879f0" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-8823c6a0-b368-4c48-a660-14afcb3879f0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] snapshot: 4899baad-18d0-41c7-a16f-0fcf44028b96, volume: 8823c6a0-b368-4c48-a660-14afcb3879f0, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c368efb-3250-459e-bee0-69f1a0c45221]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:47 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 Jul 05 02:58:47 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:47 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7d4efb34-0aea-4c0e-83e0-5ceb09539cd9 tempest-ProjectAdminTests-56527849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86671) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4832}} Jul 05 02:58:47 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96" returned: 0 in 0.767s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:58:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 02:58:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 02:58:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[254baf52-00ce-48f4-adc0-abeda8b6ef4b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:47 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 Jul 05 02:58:47 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:48 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" returned: 0 in 0.818s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:48 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 02:58:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:48 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 Jul 05 02:58:48 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:54 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0" returned: 0 in 5.809s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:54 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3672d8be-ee36-440b-9642-6df5231aa342]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:54 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 Jul 05 02:58:54 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:55 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" returned: 0 in 0.929s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:55 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 02:58:55 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Converted 1024.00 MB image at 176.24 MB/s Jul 05 02:58:55 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 is being set with open permissions: ugo+rw Jul 05 02:58:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:55 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 Jul 05 02:58:55 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:56 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0" returned: 0 in 0.716s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-8823c6a0-b368-4c48-a660-14afcb3879f0" released by "_copy_volume_from_snapshot" :: held 9.143s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-4899baad-18d0-41c7-a16f-0fcf44028b96-8823c6a0-b368-4c48-a660-14afcb3879f0" released by "_create_volume_from_snapshot" :: held 9.175s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.190s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47933e2-9918-40ee-952f-ca98849add05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8823c6a0-b368-4c48-a660-14afcb3879f0', 'volume_size': 1, 'snapshot_id': '4899baad-18d0-41c7-a16f-0fcf44028b96'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5245cfa2-ceda-4359-9992-128ae7f3c904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:58:56 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Volume volume-8823c6a0-b368-4c48-a660-14afcb3879f0 (8823c6a0-b368-4c48-a660-14afcb3879f0): created successfully Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5245cfa2-ceda-4359-9992-128ae7f3c904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Flow 'volume_create_manager' (f23d037f-573f-4cea-b843-bf8aaa2fcc62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:58:56 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e9154a2f-6313-479d-981e-aff1f0932010 tempest-VolumeDependencyTests-358949554 None] Created volume successfully. Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Acquiring lock "cinder-4899baad-18d0-41c7-a16f-0fcf44028b96-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Lock "cinder-4899baad-18d0-41c7-a16f-0fcf44028b96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Acquiring lock "cinder-quobyte-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Acquiring lock "cinder-quobyte-4899baad-18d0-41c7-a16f-0fcf44028b96" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-4899baad-18d0-41c7-a16f-0fcf44028b96" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Deleting offline snapshot 4899baad-18d0-41c7-a16f-0fcf44028b96 of volume def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] snapshot_file for this snap is: volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94869b8-7f75-4e31-b1a6-32efccd0cfde]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:57 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 Jul 05 02:58:57 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:57 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96" returned: 0 in 0.822s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:58:57 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0862606b-fba1-4b97-97c4-6c89281f9ff6]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:58:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:57 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 Jul 05 02:58:57 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:58 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" returned: 0 in 0.780s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:58 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 Jul 05 02:58:58 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:58:59 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 05 02:58:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96" returned: 0 in 0.914s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:58:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:58:59 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96 Jul 05 02:58:59 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:00 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1.4899baad-18d0-41c7-a16f-0fcf44028b96" returned: 0 in 0.753s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-4899baad-18d0-41c7-a16f-0fcf44028b96" released by "_delete_snapshot" :: held 3.382s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" released by "delete_snapshot" :: held 3.405s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:00 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Created reservations ['fc4d1ca2-36ef-4da7-a46c-1e6f2534a588', '3fbd6c28-ba08-410c-abe4-c8450577bd22', '7da05b36-8881-42da-999c-96d813e01ccc', 'fddd1127-0e49-4477-acda-c1ff19bed17f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:00 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Delete snapshot completed successfully. Jul 05 02:59:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-6da9e257-9c52-4a12-a0e6-d97c93c82803 tempest-VolumeDependencyTests-358949554 None] Lock "cinder-4899baad-18d0-41c7-a16f-0fcf44028b96-delete_snapshot" released by "delete_snapshot" :: held 3.561s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Acquiring lock "cinder-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Lock "cinder-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Acquiring lock "cinder-quobyte-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:01 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:01 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9724834-453a-4ae2-8aa1-f9f7b6cb1367]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:01 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 Jul 05 02:59:01 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Flow 'volume_create_manager' (2b6090b4-fc10-45e5-8fd9-f4769c08bcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6ebf78-b71d-49da-b8e9-eb274bf7f565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:02 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" returned: 0 in 0.820s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6ebf78-b71d-49da-b8e9-eb274bf7f565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633221109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28ffb05-71a8-4742-b46e-65e961bfce2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b22a492514d408ba252bf8775103bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:02Z,use_quota=True,user_id='d0942a3cab2c4f828bb3350d6a10a7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:02 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1 Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ad5d80-113a-4a4c-b01e-14776dbdac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:02 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ad5d80-113a-4a4c-b01e-14776dbdac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f648f450-b8ff-42a0-a8d5-0a8e180d793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f648f450-b8ff-42a0-a8d5-0a8e180d793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28ffb05-71a8-4742-b46e-65e961bfce2c', 'volume_name': 'volume-f28ffb05-71a8-4742-b46e-65e961bfce2c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3566cd5-dc23-491f-a908-6e25648f0622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3566cd5-dc23-491f-a908-6e25648f0622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607d3d40-07a3-4c94-86f2-a595a715eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:02 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Volume f28ffb05-71a8-4742-b46e-65e961bfce2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28ffb05-71a8-4742-b46e-65e961bfce2c', 'volume_size': 1} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633221109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28ffb05-71a8-4742-b46e-65e961bfce2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b22a492514d408ba252bf8775103bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:02Z,use_quota=True,user_id='d0942a3cab2c4f828bb3350d6a10a7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Creating volume f28ffb05-71a8-4742-b46e-65e961bfce2c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:59:02 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:02 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c 1073741824 Jul 05 02:59:02 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:02 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" returned: 0 in 0.723s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1" released by "delete_volume" :: held 1.631s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:02 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Created reservations ['84d2686c-73c8-4a46-ab1d-2056015083ff', 'c56fcfab-877e-4009-8156-01f98a7401ae', '231927b5-8cfc-4eec-a66d-4b7875126631', '1349969a-258c-4ba8-8352-30f969b383a9'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:03 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:59:03 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:03 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c 1073741824" returned: 0 in 0.895s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:03 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c Jul 05 02:59:03 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Acquiring lock "cinder-8823c6a0-b368-4c48-a660-14afcb3879f0-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Lock "cinder-8823c6a0-b368-4c48-a660-14afcb3879f0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Acquiring lock "cinder-quobyte-8823c6a0-b368-4c48-a660-14afcb3879f0" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-8823c6a0-b368-4c48-a660-14afcb3879f0" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[59864415-22c2-44d2-9c86-706ba182386f]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:03 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 Jul 05 02:59:03 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:03 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.798s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:59:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Deleted volume successfully. Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-cb3af1e5-91fb-4378-9f51-e98d1248077e tempest-VolumeDependencyTests-358949554 None] Lock "cinder-def48b6f-7a58-4fb3-9d06-6a78ac3d55d1-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:03 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c" returned: 0 in 0.772s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607d3d40-07a3-4c94-86f2-a595a715eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28ffb05-71a8-4742-b46e-65e961bfce2c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82856b45-98fa-4712-abba-89c1037130ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:03 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Volume volume-f28ffb05-71a8-4742-b46e-65e961bfce2c (f28ffb05-71a8-4742-b46e-65e961bfce2c): created successfully Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82856b45-98fa-4712-abba-89c1037130ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:03 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Flow 'volume_create_manager' (2b6090b4-fc10-45e5-8fd9-f4769c08bcb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-65c42cdf-1e6d-4889-b089-2ba00eeb823c tempest-ProjectReaderTests-1938780273 None] Created volume successfully. Jul 05 02:59:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Acquiring lock "cinder-f28ffb05-71a8-4742-b46e-65e961bfce2c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:04 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Lock "cinder-f28ffb05-71a8-4742-b46e-65e961bfce2c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0" returned: 0 in 0.783s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:04 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0 Jul 05 02:59:04 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Acquiring lock "cinder-quobyte-f28ffb05-71a8-4742-b46e-65e961bfce2c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Lock "cinder-quobyte-f28ffb05-71a8-4742-b46e-65e961bfce2c" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d793d2c5-4a9c-457f-b2f8-f7aacae87af0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:04 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c Jul 05 02:59:04 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:05 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-8823c6a0-b368-4c48-a660-14afcb3879f0" returned: 0 in 0.702s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Lock "cinder-quobyte-8823c6a0-b368-4c48-a660-14afcb3879f0" released by "delete_volume" :: held 1.535s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Created reservations ['594c9ae0-7735-4465-a61c-cbacbee85429', '3a8dc2c1-2539-452f-96cc-46d223419c2b', '2577e132-7a63-4fc8-9a3b-b9acc9c23ec5', '0a4ca29b-ac26-4ee8-a61c-8e7569915cfc'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:05 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:59:05 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:05 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c" returned: 0 in 0.806s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:05 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c Jul 05 02:59:05 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:05 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:59:05 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:06 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.940s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:59:06 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Deleted volume successfully. Jul 05 02:59:06 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f28ffb05-71a8-4742-b46e-65e961bfce2c" returned: 0 in 0.899s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Lock "cinder-quobyte-f28ffb05-71a8-4742-b46e-65e961bfce2c" released by "delete_volume" :: held 1.759s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-c0e48341-59a2-4749-9ba8-e753a0e19f4d tempest-VolumeDependencyTests-358949554 None] Lock "cinder-8823c6a0-b368-4c48-a660-14afcb3879f0-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Created reservations ['5be20c27-83b1-4361-8965-16461ea8997f', '7639f750-75e6-436f-9f71-5e119ddc1c98', 'bf7b7035-d271-42b6-b63f-f7ad3c1b3fe6', '84bd8d65-4206-4450-99aa-4f4716408131'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:06 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 1.003s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 02:59:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 02:59:06 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:59:06 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:07 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.799s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:59:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Deleted volume successfully. Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-21c34bad-86c4-4598-a5a7-fd43e39df2ae tempest-ProjectReaderTests-1938780273 None] Lock "cinder-f28ffb05-71a8-4742-b46e-65e961bfce2c-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Flow 'volume_create_manager' (b74030bd-3003-4691-9565-271ef699dd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dfdd24-4b89-425b-b450-f9b87223c899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dfdd24-4b89-425b-b450-f9b87223c899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985006911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e8944b-e739-4946-a009-ff9937a26244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b22a492514d408ba252bf8775103bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:07Z,use_quota=True,user_id='d0942a3cab2c4f828bb3350d6a10a7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ae6426-a6b8-468e-8fbe-8744675489c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ae6426-a6b8-468e-8fbe-8744675489c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65503e65-a65d-4e93-bf24-a4902d8b19a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65503e65-a65d-4e93-bf24-a4902d8b19a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e8944b-e739-4946-a009-ff9937a26244', 'volume_name': 'volume-b1e8944b-e739-4946-a009-ff9937a26244', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79835287-aae5-4bfb-b8d1-00df862095ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79835287-aae5-4bfb-b8d1-00df862095ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ba3e0c-ff19-45c9-912b-772b1b9f7743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:07 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Volume b1e8944b-e739-4946-a009-ff9937a26244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e8944b-e739-4946-a009-ff9937a26244', 'volume_size': 1} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1985006911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e8944b-e739-4946-a009-ff9937a26244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b22a492514d408ba252bf8775103bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:07Z,use_quota=True,user_id='d0942a3cab2c4f828bb3350d6a10a7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Creating volume b1e8944b-e739-4946-a009-ff9937a26244 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:59:07 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:59:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:07 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244 1073741824 Jul 05 02:59:07 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:08 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244 1073741824" returned: 0 in 0.962s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:08 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244 Jul 05 02:59:08 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:09 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244" returned: 0 in 0.700s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ba3e0c-ff19-45c9-912b-772b1b9f7743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e8944b-e739-4946-a009-ff9937a26244', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03856d02-0342-4e9d-8f42-aeefdb92b519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:09 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Volume volume-b1e8944b-e739-4946-a009-ff9937a26244 (b1e8944b-e739-4946-a009-ff9937a26244): created successfully Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03856d02-0342-4e9d-8f42-aeefdb92b519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Flow 'volume_create_manager' (b74030bd-3003-4691-9565-271ef699dd36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:09 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-7163b876-7f20-432b-b480-b70c81750230 tempest-ProjectReaderTests-1938780273 None] Created volume successfully. Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "cinder-b1e8944b-e739-4946-a009-ff9937a26244-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Lock "cinder-b1e8944b-e739-4946-a009-ff9937a26244-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "cinder-quobyte-b1e8944b-e739-4946-a009-ff9937a26244" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Lock "cinder-quobyte-b1e8944b-e739-4946-a009-ff9937a26244" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec1046-3e86-47b7-9643-0aaad05369b9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:09 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244 Jul 05 02:59:09 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (2de77bcc-a61f-416d-b4a5-179582f068f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348c5e2a-d98a-4bae-9600-9026f3f7097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348c5e2a-d98a-4bae-9600-9026f3f7097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-759332734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:10Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e407abbd-e80f-45e5-ada7-e7098056e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e407abbd-e80f-45e5-ada7-e7098056e321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c204129e-1399-40d6-ae7e-0d8847fb6c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c204129e-1399-40d6-ae7e-0d8847fb6c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c', 'volume_name': 'volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90f908d-269d-4065-94b1-d79a8bd602d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90f908d-269d-4065-94b1-d79a8bd602d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cf64c7-8f93-4cfa-9f88-a26e78e113d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:10 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Volume 4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c', 'volume_size': 1} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-759332734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:10Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Creating volume 4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:59:10 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:10 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c 1073741824 Jul 05 02:59:10 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:10 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244" returned: 0 in 0.856s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:10 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244 Jul 05 02:59:10 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:11 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-b1e8944b-e739-4946-a009-ff9937a26244" returned: 0 in 0.802s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Lock "cinder-quobyte-b1e8944b-e739-4946-a009-ff9937a26244" released by "delete_volume" :: held 1.706s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Created reservations ['a48e481f-5934-4720-80af-acf2e6a82b8b', '4b16062a-3c1c-4f7c-97d8-5b99fdbff9dc', 'efadf09f-42dc-49cc-bd6d-705738f2113e', 'fe82ebbe-4313-4c1b-a0e1-992426ded68c'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:11 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c 1073741824" returned: 0 in 0.959s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:11 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c Jul 05 02:59:11 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:11 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:59:11 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:12 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" returned: 0 in 0.833s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cf64c7-8f93-4cfa-9f88-a26e78e113d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:12 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa14084-33e1-4446-ac59-d40c7c784cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.849s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:59:12 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Deleted volume successfully. Jul 05 02:59:12 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Volume volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c (4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c): created successfully Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa14084-33e1-4446-ac59-d40c7c784cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (2de77bcc-a61f-416d-b4a5-179582f068f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-08ac6750-181a-4822-a85d-fde87d5e6813 tempest-ProjectReaderTests-1938780273 None] Lock "cinder-b1e8944b-e739-4946-a009-ff9937a26244-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:12 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d0869510-2b0c-45f5-8d8f-5a93fd09d061 tempest-ProjectMemberTests-240412322 None] Created volume successfully. Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Flow 'volume_create_manager' (c287270c-5c4b-4681-b3fc-78a1daac75ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fdef73-caa1-45d1-af73-109ca4e73952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fdef73-caa1-45d1-af73-109ca4e73952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929368025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2c0e52-5319-4cc6-87a5-72833f4881e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b22a492514d408ba252bf8775103bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:12Z,use_quota=True,user_id='d0942a3cab2c4f828bb3350d6a10a7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74866538-5f9f-47bf-8c03-c374ed15280d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74866538-5f9f-47bf-8c03-c374ed15280d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e30b9f7-b2f4-4d7a-8666-15648105a51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e30b9f7-b2f4-4d7a-8666-15648105a51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2c0e52-5319-4cc6-87a5-72833f4881e0', 'volume_name': 'volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4478bc3b-83c9-4cda-9ab0-66a09447356f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4478bc3b-83c9-4cda-9ab0-66a09447356f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cb86ba-d819-4838-8452-059b52d2bcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:12 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Volume 9f2c0e52-5319-4cc6-87a5-72833f4881e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0', 'volume_size': 1} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-929368025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2c0e52-5319-4cc6-87a5-72833f4881e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b22a492514d408ba252bf8775103bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:12Z,use_quota=True,user_id='d0942a3cab2c4f828bb3350d6a10a7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Creating volume 9f2c0e52-5319-4cc6-87a5-72833f4881e0 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:59:12 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:59:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:12 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0 1073741824 Jul 05 02:59:12 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:13 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0 1073741824" returned: 0 in 0.861s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:13 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0 Jul 05 02:59:13 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:14 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0" returned: 0 in 0.690s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.081s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Creating offline snapshot a6564780-24ad-49d9-9eec-b8499c32b9ce of volume 4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cb86ba-d819-4838-8452-059b52d2bcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbae056-b7a3-4be7-99d3-eccb041573e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[114db758-4399-4ce2-89ad-94a5cd85ea26]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:14 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Volume volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0 (9f2c0e52-5319-4cc6-87a5-72833f4881e0): created successfully Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbae056-b7a3-4be7-99d3-eccb041573e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Flow 'volume_create_manager' (c287270c-5c4b-4681-b3fc-78a1daac75ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:14 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-2f179100-7b68-46ce-944e-3fa6f6e8cf32 tempest-ProjectReaderTests-1938780273 None] Created volume successfully. Jul 05 02:59:14 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c Jul 05 02:59:14 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "cinder-9f2c0e52-5319-4cc6-87a5-72833f4881e0-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Lock "cinder-9f2c0e52-5319-4cc6-87a5-72833f4881e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "cinder-quobyte-9f2c0e52-5319-4cc6-87a5-72833f4881e0" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Lock "cinder-quobyte-9f2c0e52-5319-4cc6-87a5-72833f4881e0" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0564d929-f2fc-4ec6-a923-6750b045b011]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:14 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0 Jul 05 02:59:14 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:14 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" returned: 0 in 0.817s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:14 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce 1G Jul 05 02:59:14 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:15 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0" returned: 0 in 0.849s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:15 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0 Jul 05 02:59:15 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:15 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce 1G" returned: 0 in 0.898s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:15 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce Jul 05 02:59:15 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:16 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-9f2c0e52-5319-4cc6-87a5-72833f4881e0" returned: 0 in 0.688s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Lock "cinder-quobyte-9f2c0e52-5319-4cc6-87a5-72833f4881e0" released by "delete_volume" :: held 1.589s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Created reservations ['c07feecb-e74a-41cf-8ed8-41425a6c44c1', '32c9b4e4-b049-4f80-97ab-32484ae35611', '29963f3c-e4ee-44a0-b355-b19e523165bd', '64ecc18f-64fb-4c06-b609-9d9682573f75'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:16 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:59:16 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:16 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce" returned: 0 in 0.809s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:16 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce is being set with open permissions: ugo+rw Jul 05 02:59:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:16 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce Jul 05 02:59:16 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:17 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.816s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:59:17 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Deleted volume successfully. Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-aab6d83c-0433-417d-bd84-bf892e66f4e3 tempest-ProjectReaderTests-1938780273 None] Lock "cinder-9f2c0e52-5319-4cc6-87a5-72833f4881e0-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Flow 'volume_create_manager' (8b8883c1-efa2-4e4c-8b74-f625eb4e1338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7f935f-7fdd-47cd-8a25-0c5ecfee3d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7f935f-7fdd-47cd-8a25-0c5ecfee3d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2043887116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a32d71-d2ff-4966-b859-688e0445d136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b22a492514d408ba252bf8775103bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:17Z,use_quota=True,user_id='d0942a3cab2c4f828bb3350d6a10a7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f34c87-bb94-4acc-bac2-24ab4491670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f34c87-bb94-4acc-bac2-24ab4491670d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b26623-c18c-4d3c-a458-e50b2f76757f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b26623-c18c-4d3c-a458-e50b2f76757f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a32d71-d2ff-4966-b859-688e0445d136', 'volume_name': 'volume-86a32d71-d2ff-4966-b859-688e0445d136', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fb6af9-c738-4261-9353-1866a1f66e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fb6af9-c738-4261-9353-1866a1f66e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:17 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be7a7fe-f672-4064-b50b-a1e33ffaf66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:17 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Volume 86a32d71-d2ff-4966-b859-688e0445d136: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a32d71-d2ff-4966-b859-688e0445d136', 'volume_size': 1} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce" returned: 0 in 0.864s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:17 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.info Jul 05 02:59:17 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:18 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.info" returned: 0 in 0.648s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:18 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.info is being set with open permissions: ugo+rw Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:18 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.info Jul 05 02:59:18 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:18 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.info" returned: 0 in 0.636s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.769s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2043887116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a32d71-d2ff-4966-b859-688e0445d136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b22a492514d408ba252bf8775103bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:17Z,use_quota=True,user_id='d0942a3cab2c4f828bb3350d6a10a7c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Creating volume 86a32d71-d2ff-4966-b859-688e0445d136 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:59:18 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:59:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:18 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136 1073741824 Jul 05 02:59:18 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-29501985-a7a5-4da4-afdb-ef99d44a122c tempest-ProjectMemberTests-240412322 None] Create snapshot completed successfully Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-a6564780-24ad-49d9-9eec-b8499c32b9ce-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Lock "cinder-a6564780-24ad-49d9-9eec-b8499c32b9ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-a6564780-24ad-49d9-9eec-b8499c32b9ce" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-a6564780-24ad-49d9-9eec-b8499c32b9ce" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Deleting offline snapshot a6564780-24ad-49d9-9eec-b8499c32b9ce of volume 4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] snapshot_file for this snap is: volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c41f9d-0933-4e8b-a9ff-50694a7fa66b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:19 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce Jul 05 02:59:19 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:19 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136 1073741824" returned: 0 in 0.906s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:19 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136 Jul 05 02:59:19 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:20 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce" returned: 0 in 0.870s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d5b1d4-d4a3-4645-ace4-5929352b0959]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:20 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c Jul 05 02:59:20 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:20 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136" returned: 0 in 0.697s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be7a7fe-f672-4064-b50b-a1e33ffaf66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a32d71-d2ff-4966-b859-688e0445d136', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a874b9-f286-4d52-bf7d-95959af3d693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:20 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Volume volume-86a32d71-d2ff-4966-b859-688e0445d136 (86a32d71-d2ff-4966-b859-688e0445d136): created successfully Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a874b9-f286-4d52-bf7d-95959af3d693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:20 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Flow 'volume_create_manager' (8b8883c1-efa2-4e4c-8b74-f625eb4e1338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:20 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-cab09c82-4e46-4577-b645-9620650fa4b9 tempest-ProjectReaderTests-1938780273 None] Created volume successfully. Jul 05 02:59:21 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" returned: 0 in 0.826s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:21 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce Jul 05 02:59:21 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Acquiring lock "cinder-86a32d71-d2ff-4966-b859-688e0445d136-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Lock "cinder-86a32d71-d2ff-4966-b859-688e0445d136-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Acquiring lock "cinder-quobyte-86a32d71-d2ff-4966-b859-688e0445d136" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Lock "cinder-quobyte-86a32d71-d2ff-4966-b859-688e0445d136" acquired by "delete_volume" :: waited 0.028s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:21 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8fd59a-28c4-4c9b-aa5e-c94e9c70ca82]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:21 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136 Jul 05 02:59:21 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:21 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce" returned: 0 in 0.834s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:21 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce Jul 05 02:59:21 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:22 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c.a6564780-24ad-49d9-9eec-b8499c32b9ce" returned: 0 in 0.640s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:22 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136" returned: 0 in 0.815s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:22 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136 Jul 05 02:59:22 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-a6564780-24ad-49d9-9eec-b8499c32b9ce" released by "_delete_snapshot" :: held 3.304s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" released by "delete_snapshot" :: held 3.332s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:22 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Created reservations ['0c9c22af-d6d1-4b3d-a54a-d4d8e12dc263', 'd0aef145-af21-4ab2-9149-efd4ce4be70c', '98a38fd7-fca6-48ac-a5bd-ef34b4a7acdf', '1c78e4cc-b87d-4c3f-85ab-469f8604af4b'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:22 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Delete snapshot completed successfully. Jul 05 02:59:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8cbe0cf7-fc99-4ac8-ae12-c8cf707fe7c9 tempest-ProjectMemberTests-240412322 None] Lock "cinder-a6564780-24ad-49d9-9eec-b8499c32b9ce-delete_snapshot" released by "delete_snapshot" :: held 3.462s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:23 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-86a32d71-d2ff-4966-b859-688e0445d136" returned: 0 in 0.632s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Lock "cinder-quobyte-86a32d71-d2ff-4966-b859-688e0445d136" released by "delete_volume" :: held 1.484s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Created reservations ['cda55e6c-bccf-4a0f-977e-8a99488b45c2', '62bbedac-41e3-4605-8b78-49374b5f95e0', '490f1bd0-c577-4faa-ae79-56d93de77298', '3c629098-8b13-492f-9499-679f84cfcab9'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:23 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:59:23 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Lock "cinder-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" acquired by "delete_volume" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a55f0e-91d6-44cb-82e4-3e3ceb71db2c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:23 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c Jul 05 02:59:23 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:23 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.676s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:23 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:59:23 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Deleted volume successfully. Jul 05 02:59:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d182fbca-a5bc-4f28-9b46-4f7641d5edaa tempest-ProjectReaderTests-1938780273 None] Lock "cinder-86a32d71-d2ff-4966-b859-688e0445d136-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:24 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" returned: 0 in 0.754s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:24 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c Jul 05 02:59:24 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:24 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" returned: 0 in 0.666s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c" released by "delete_volume" :: held 1.479s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Created reservations ['a9439566-a90d-4e39-a801-be7d63d433de', 'c7d60623-c671-4c01-aeb9-66678795204e', 'f8bb918e-64ef-4ad7-8957-a89f7ec700b1', 'c6ee80cd-0020-4c24-9ff5-c5b884685259'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:25 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:59:25 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:25 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.707s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:59:25 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Deleted volume successfully. Jul 05 02:59:25 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-b1d3fa30-f47d-4c0f-812c-a9797e9bfd32 tempest-ProjectMemberTests-240412322 None] Lock "cinder-4a3ad6a5-bd4f-4dc4-ac2a-59e27d31d37c-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=122,cinder:INSERT=44,cinder:UPDATE=163,cinder:DELETE=12 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=150,cinder:SELECT=117,cinder:INSERT=44,cinder:DELETE=14 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (18f14347-73f1-4cd7-90bb-a196c8005b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cd9db4-2fdf-43e1-947b-6d775698a33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cd9db4-2fdf-43e1-947b-6d775698a33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-939398066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76195738-c908-4341-a691-faf3f0c049b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:26Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa813d2-44de-4f3d-af6f-f863ac10a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa813d2-44de-4f3d-af6f-f863ac10a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13a9147-2849-48a4-b0b2-5d3e360a6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13a9147-2849-48a4-b0b2-5d3e360a6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76195738-c908-4341-a691-faf3f0c049b1', 'volume_name': 'volume-76195738-c908-4341-a691-faf3f0c049b1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee83740-948e-4f9f-a6e1-4f0fa82fa4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee83740-948e-4f9f-a6e1-4f0fa82fa4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e443f2-5708-4032-b262-afcfd8fbf56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:26 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Volume 76195738-c908-4341-a691-faf3f0c049b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76195738-c908-4341-a691-faf3f0c049b1', 'volume_size': 1} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-939398066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76195738-c908-4341-a691-faf3f0c049b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:26Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Creating volume 76195738-c908-4341-a691-faf3f0c049b1 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:59:26 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:59:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:26 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 1073741824 Jul 05 02:59:26 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:27 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 1073741824" returned: 0 in 0.789s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:27 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 Jul 05 02:59:27 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:27 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1" returned: 0 in 0.646s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:59:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e443f2-5708-4032-b262-afcfd8fbf56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76195738-c908-4341-a691-faf3f0c049b1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee0abd8-e716-4aaa-8451-d9fbaae63572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:27 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Volume volume-76195738-c908-4341-a691-faf3f0c049b1 (76195738-c908-4341-a691-faf3f0c049b1): created successfully Jul 05 02:59:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee0abd8-e716-4aaa-8451-d9fbaae63572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (18f14347-73f1-4cd7-90bb-a196c8005b5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8fc43200-9802-4fb6-808f-c3fdf9bedad4 tempest-ProjectMemberTests-240412322 None] Created volume successfully. Jul 05 02:59:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Creating offline snapshot 6d2ca24b-e977-4dad-b932-7f72ee87bcf0 of volume 76195738-c908-4341-a691-faf3f0c049b1 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:59:28 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[953c6da3-4a6d-49a7-a133-26cc4e2f6b0b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:28 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 Jul 05 02:59:28 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:29 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1" returned: 0 in 0.752s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:29 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 1G Jul 05 02:59:29 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:29 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 1G" returned: 0 in 0.780s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76195738-c908-4341-a691-faf3f0c049b1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:29 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76195738-c908-4341-a691-faf3f0c049b1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 Jul 05 02:59:29 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:30 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76195738-c908-4341-a691-faf3f0c049b1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0" returned: 0 in 0.674s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:30 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 is being set with open permissions: ugo+rw Jul 05 02:59:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:30 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 Jul 05 02:59:30 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:31 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0" returned: 0 in 0.625s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:31 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.info Jul 05 02:59:31 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:31 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.info" returned: 0 in 0.670s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:31 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.info is being set with open permissions: ugo+rw Jul 05 02:59:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:31 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.info Jul 05 02:59:31 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:32 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.info" returned: 0 in 0.622s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.197s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:32 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-74ac52ed-ee82-481a-89fe-23d6490c4c23 tempest-ProjectMemberTests-240412322 None] Create snapshot completed successfully Jul 05 02:59:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-6d2ca24b-e977-4dad-b932-7f72ee87bcf0-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Lock "cinder-6d2ca24b-e977-4dad-b932-7f72ee87bcf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-76195738-c908-4341-a691-faf3f0c049b1" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-76195738-c908-4341-a691-faf3f0c049b1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-6d2ca24b-e977-4dad-b932-7f72ee87bcf0" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-6d2ca24b-e977-4dad-b932-7f72ee87bcf0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Deleting offline snapshot 6d2ca24b-e977-4dad-b932-7f72ee87bcf0 of volume 76195738-c908-4341-a691-faf3f0c049b1 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:59:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] snapshot_file for this snap is: volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:59:33 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e0201f-bef8-4409-9b4c-c399c12e3da9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:33 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 Jul 05 02:59:33 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:34 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0" returned: 0 in 0.728s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:34 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76195738-c908-4341-a691-faf3f0c049b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:59:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a0ec42-d9d4-4e6e-bdf3-eac7f1035aac]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:34 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 Jul 05 02:59:34 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:35 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1" returned: 0 in 0.739s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:35 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 Jul 05 02:59:35 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:35 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0" returned: 0 in 0.718s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:35 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0 Jul 05 02:59:35 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:36 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1.6d2ca24b-e977-4dad-b932-7f72ee87bcf0" returned: 0 in 0.639s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-6d2ca24b-e977-4dad-b932-7f72ee87bcf0" released by "_delete_snapshot" :: held 2.916s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-76195738-c908-4341-a691-faf3f0c049b1" released by "delete_snapshot" :: held 2.938s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Created reservations ['c4b0ff21-9a9f-4e62-9a0f-a2bf8d8f45ad', 'f99aaf31-2d6a-44cb-b5f7-d9a928021fa9', '3f9aba1b-c34b-4a0f-b2db-f76e58492d7f', '8e79d7b5-1a7b-42b8-a9c1-1b83615088fc'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Delete snapshot completed successfully. Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-e3e03269-70f0-462c-9f32-e682b73dfa71 tempest-ProjectMemberTests-240412322 None] Lock "cinder-6d2ca24b-e977-4dad-b932-7f72ee87bcf0-delete_snapshot" released by "delete_snapshot" :: held 3.060s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-76195738-c908-4341-a691-faf3f0c049b1-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Lock "cinder-76195738-c908-4341-a691-faf3f0c049b1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-76195738-c908-4341-a691-faf3f0c049b1" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-76195738-c908-4341-a691-faf3f0c049b1" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac15d281-438d-40c6-b8dc-648e1cadd3ac]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:36 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 Jul 05 02:59:36 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:37 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1" returned: 0 in 0.758s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:37 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1 Jul 05 02:59:37 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:38 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-76195738-c908-4341-a691-faf3f0c049b1" returned: 0 in 0.637s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-76195738-c908-4341-a691-faf3f0c049b1" released by "delete_volume" :: held 1.449s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:38 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Created reservations ['621ade49-0373-409c-b232-40432be80246', '374178f8-5a76-4a54-8fc7-bdf79988c7d6', 'e11c257e-6289-4d36-8729-1d3823c39227', '06ee063e-599f-467d-a1c4-f6c3ddb57570'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:38 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:59:38 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:39 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.643s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:59:39 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Deleted volume successfully. Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dea5ce16-e4d4-42f7-a1cd-1d8d03dc48d2 tempest-ProjectMemberTests-240412322 None] Lock "cinder-76195738-c908-4341-a691-faf3f0c049b1-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (eaa6a1a8-e402-45e2-8430-8c208a455d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4c7658-9d40-4a2c-8948-f6f50e850148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4c7658-9d40-4a2c-8948-f6f50e850148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-558981626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca77703f-64b1-4143-9a69-fe45ef6e44cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:39Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd318e7-1a1b-476c-9e10-dc999bb02bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd318e7-1a1b-476c-9e10-dc999bb02bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb90c04-a6ed-4619-8dc1-9f2a958d1a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb90c04-a6ed-4619-8dc1-9f2a958d1a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca77703f-64b1-4143-9a69-fe45ef6e44cc', 'volume_name': 'volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9611cf-1029-487c-a684-753254f81763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9611cf-1029-487c-a684-753254f81763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1363785-7e3b-47fd-ab6c-765371d46adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:39 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Volume ca77703f-64b1-4143-9a69-fe45ef6e44cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc', 'volume_size': 1} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-558981626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca77703f-64b1-4143-9a69-fe45ef6e44cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:39Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Creating volume ca77703f-64b1-4143-9a69-fe45ef6e44cc {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:59:39 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:59:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:39 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc 1073741824 Jul 05 02:59:39 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:40 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc 1073741824" returned: 0 in 0.792s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:40 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc Jul 05 02:59:40 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:40 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc" returned: 0 in 0.628s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:40 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:59:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1363785-7e3b-47fd-ab6c-765371d46adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1048beaa-ba16-4473-acc8-4ca0db1eeb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:40 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Volume volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc (ca77703f-64b1-4143-9a69-fe45ef6e44cc): created successfully Jul 05 02:59:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1048beaa-ba16-4473-acc8-4ca0db1eeb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:40 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (eaa6a1a8-e402-45e2-8430-8c208a455d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ac0f73db-cd11-483b-b367-119f816ec957 tempest-ProjectMemberTests-240412322 None] Created volume successfully. Jul 05 02:59:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Creating offline snapshot 731aefb3-913b-4f1c-9ad3-40c579ba41f5 of volume ca77703f-64b1-4143-9a69-fe45ef6e44cc {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:59:41 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e81a6a-0d40-4605-b3ba-dce4f33a8c05]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:41 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc Jul 05 02:59:41 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:42 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc" returned: 0 in 0.747s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:42 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 1G Jul 05 02:59:42 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:43 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 1G" returned: 0 in 0.782s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:43 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 Jul 05 02:59:43 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:43 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5" returned: 0 in 0.663s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:43 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 is being set with open permissions: ugo+rw Jul 05 02:59:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:43 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 Jul 05 02:59:43 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:44 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5" returned: 0 in 0.633s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:44 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.info Jul 05 02:59:44 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:45 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.info" returned: 0 in 0.633s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:45 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.info is being set with open permissions: ugo+rw Jul 05 02:59:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:45 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.info Jul 05 02:59:45 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:45 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.info" returned: 0 in 0.625s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.157s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8f8fa010-6efa-4288-9455-92f3f006a057 tempest-ProjectMemberTests-240412322 None] Create snapshot completed successfully Jul 05 02:59:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-731aefb3-913b-4f1c-9ad3-40c579ba41f5-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Lock "cinder-731aefb3-913b-4f1c-9ad3-40c579ba41f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-ca77703f-64b1-4143-9a69-fe45ef6e44cc" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-ca77703f-64b1-4143-9a69-fe45ef6e44cc" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-731aefb3-913b-4f1c-9ad3-40c579ba41f5" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-731aefb3-913b-4f1c-9ad3-40c579ba41f5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Deleting offline snapshot 731aefb3-913b-4f1c-9ad3-40c579ba41f5 of volume ca77703f-64b1-4143-9a69-fe45ef6e44cc {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 02:59:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] snapshot_file for this snap is: volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 02:59:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8ea66d-0859-4def-b04b-c84c9672e788]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:47 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 Jul 05 02:59:47 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:47 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5" returned: 0 in 0.743s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:47 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 02:59:47 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2055e55-aad8-4188-8169-2b202a383b23]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:47 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc Jul 05 02:59:47 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:48 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc" returned: 0 in 0.735s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:48 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 Jul 05 02:59:48 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:49 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5" returned: 0 in 0.710s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:49 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5 Jul 05 02:59:49 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:49 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc.731aefb3-913b-4f1c-9ad3-40c579ba41f5" returned: 0 in 0.620s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-731aefb3-913b-4f1c-9ad3-40c579ba41f5" released by "_delete_snapshot" :: held 2.893s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-ca77703f-64b1-4143-9a69-fe45ef6e44cc" released by "delete_snapshot" :: held 2.915s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:49 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Created reservations ['ca218ded-1327-4e32-91b1-ea02a25be7a0', 'bef72ca5-5a1a-4f60-828d-2198c8630d0d', '5d34f760-4595-4b41-8520-a74c365526b6', '4f416612-1668-49d5-ab90-03c1ce17b4d9'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:49 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Delete snapshot completed successfully. Jul 05 02:59:49 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-d693645d-a9b0-4a0e-9c07-126648cda1dc tempest-ProjectMemberTests-240412322 None] Lock "cinder-731aefb3-913b-4f1c-9ad3-40c579ba41f5-delete_snapshot" released by "delete_snapshot" :: held 3.036s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-ca77703f-64b1-4143-9a69-fe45ef6e44cc-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Lock "cinder-ca77703f-64b1-4143-9a69-fe45ef6e44cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-ca77703f-64b1-4143-9a69-fe45ef6e44cc" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 02:59:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-ca77703f-64b1-4143-9a69-fe45ef6e44cc" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 02:59:50 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[85373ffb-1409-46bb-8c03-000f21f03be0]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:50 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc Jul 05 02:59:50 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:50 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc" returned: 0 in 0.752s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:50 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc Jul 05 02:59:50 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:51 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-ca77703f-64b1-4143-9a69-fe45ef6e44cc" returned: 0 in 0.632s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-ca77703f-64b1-4143-9a69-fe45ef6e44cc" released by "delete_volume" :: held 1.436s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:51 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Created reservations ['c2396b70-a484-43ad-b221-c7b22b58aac0', '8774b714-eaa8-46b1-9ec4-168b0784b9a5', '116d60d0-d914-4326-ab97-9f7dbe7b6a89', '0e14b6d7-b806-4710-be8c-0d44a731dffd'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 02:59:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:51 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 02:59:51 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:52 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.650s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 02:59:52 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Deleted volume successfully. Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-de36961f-a363-47a0-8546-d3dddd133167 tempest-ProjectMemberTests-240412322 None] Lock "cinder-ca77703f-64b1-4143-9a69-fe45ef6e44cc-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (3674796a-461d-4511-b13e-4387b203466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd15c66c-cc32-40e3-99ce-80894853401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd15c66c-cc32-40e3-99ce-80894853401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-757834261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18d2358-7d77-43cd-83f6-8f572f878ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:53Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bf89db-43bc-4d62-b6db-9242c7a37107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2bf89db-43bc-4d62-b6db-9242c7a37107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4eb7fc-a5a8-4cde-9b97-b0dafc117a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4eb7fc-a5a8-4cde-9b97-b0dafc117a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18d2358-7d77-43cd-83f6-8f572f878ce1', 'volume_name': 'volume-f18d2358-7d77-43cd-83f6-8f572f878ce1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8895d877-d20c-4168-8d61-4185e2ba7ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8895d877-d20c-4168-8d61-4185e2ba7ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3668d943-e931-40dc-828a-a63a3fa25534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:52 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Volume f18d2358-7d77-43cd-83f6-8f572f878ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18d2358-7d77-43cd-83f6-8f572f878ce1', 'volume_size': 1} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T00:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-757834261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18d2358-7d77-43cd-83f6-8f572f878ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T00:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T00:59:53Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Creating volume f18d2358-7d77-43cd-83f6-8f572f878ce1 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 02:59:52 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 02:59:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:52 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 1073741824 Jul 05 02:59:52 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:53 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 1073741824" returned: 0 in 0.833s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:53 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 Jul 05 02:59:53 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:54 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1" returned: 0 in 0.623s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3668d943-e931-40dc-828a-a63a3fa25534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18d2358-7d77-43cd-83f6-8f572f878ce1', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f0bbc8-2cfa-4415-9ab9-3a57867188cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 02:59:54 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Volume volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 (f18d2358-7d77-43cd-83f6-8f572f878ce1): created successfully Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f0bbc8-2cfa-4415-9ab9-3a57867188cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (3674796a-461d-4511-b13e-4387b203466c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 02:59:54 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c0fc4f2f-5e1f-4f87-8766-94e73558c054 tempest-ProjectMemberTests-240412322 None] Created volume successfully. Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Creating offline snapshot fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 of volume f18d2358-7d77-43cd-83f6-8f572f878ce1 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dee8c6f-ca21-4add-b48c-a58b6e1273b5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 02:59:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:55 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 Jul 05 02:59:55 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:55 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1" returned: 0 in 0.744s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:55 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 1G Jul 05 02:59:55 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:56 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 1G" returned: 0 in 0.771s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:56 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 Jul 05 02:59:56 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:57 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220" returned: 0 in 0.667s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:57 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 is being set with open permissions: ugo+rw Jul 05 02:59:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:57 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 Jul 05 02:59:57 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:57 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220" returned: 0 in 0.619s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:57 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.info Jul 05 02:59:57 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:58 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.info" returned: 0 in 0.632s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:58 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.info is being set with open permissions: ugo+rw Jul 05 02:59:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 02:59:58 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.info Jul 05 02:59:58 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 02:59:59 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 05 02:59:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.info" returned: 0 in 0.637s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 02:59:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.151s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 02:59:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1f7547f7-dc2d-4446-8450-f893cf495f7f tempest-ProjectMemberTests-240412322 None] Create snapshot completed successfully Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-fcf2fa3f-ee79-44d8-99a8-c6d97fae9220-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Lock "cinder-fcf2fa3f-ee79-44d8-99a8-c6d97fae9220-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-f18d2358-7d77-43cd-83f6-8f572f878ce1" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f18d2358-7d77-43cd-83f6-8f572f878ce1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-fcf2fa3f-ee79-44d8-99a8-c6d97fae9220" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-fcf2fa3f-ee79-44d8-99a8-c6d97fae9220" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Deleting offline snapshot fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 of volume f18d2358-7d77-43cd-83f6-8f572f878ce1 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] snapshot_file for this snap is: volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef33931-8e98-4b8c-83e2-5ffc442ad43d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:00 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 Jul 05 03:00:00 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:00 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220" returned: 0 in 0.753s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18d2358-7d77-43cd-83f6-8f572f878ce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d6a380-c939-4fb5-b14d-b92019d925bb]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:00:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:01 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 Jul 05 03:00:01 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:01 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1" returned: 0 in 0.741s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:01 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 Jul 05 03:00:01 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:02 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220" returned: 0 in 0.714s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:02 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220 Jul 05 03:00:02 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:03 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1.fcf2fa3f-ee79-44d8-99a8-c6d97fae9220" returned: 0 in 0.646s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-fcf2fa3f-ee79-44d8-99a8-c6d97fae9220" released by "_delete_snapshot" :: held 2.945s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f18d2358-7d77-43cd-83f6-8f572f878ce1" released by "delete_snapshot" :: held 2.969s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Created reservations ['1eee74c3-1025-4a4c-ba82-d337f6a3d8a2', 'ad6e11f9-d90c-4dfb-b2a0-1ce4572afa45', '92c58dce-951b-4c18-b7bf-8f8689ec534c', 'eca9f2a1-abc3-4b3a-b0eb-04e7e5f4b719'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:00:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Delete snapshot completed successfully. Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ed3fe1b2-4c68-4986-baf8-3a7b3006a95f tempest-ProjectMemberTests-240412322 None] Lock "cinder-fcf2fa3f-ee79-44d8-99a8-c6d97fae9220-delete_snapshot" released by "delete_snapshot" :: held 3.100s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-f18d2358-7d77-43cd-83f6-8f572f878ce1-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Lock "cinder-f18d2358-7d77-43cd-83f6-8f572f878ce1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-f18d2358-7d77-43cd-83f6-8f572f878ce1" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f18d2358-7d77-43cd-83f6-8f572f878ce1" acquired by "delete_volume" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba45e85-cee8-4c02-90d1-2af991772c4c]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:00:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:03 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 Jul 05 03:00:03 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:04 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1" returned: 0 in 0.738s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:04 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1 Jul 05 03:00:04 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:04 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f18d2358-7d77-43cd-83f6-8f572f878ce1" returned: 0 in 0.637s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f18d2358-7d77-43cd-83f6-8f572f878ce1" released by "delete_volume" :: held 1.427s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Created reservations ['0d2846c4-1b24-4feb-92cd-9b06d71f91a1', '7c7cb35a-1600-4978-8297-86e76f1b2215', '1aae4632-84d2-4b15-ba5a-0a61f615ec61', 'a95c354f-ea7d-46e2-b717-c8618b197939'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:00:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:04 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:00:04 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:05 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:00:05 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:05 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.638s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:00:05 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Deleted volume successfully. Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-9a8b7757-2e2a-44ec-bb27-21d4c419ee4d tempest-ProjectMemberTests-240412322 None] Lock "cinder-f18d2358-7d77-43cd-83f6-8f572f878ce1-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (850c12d2-59b0-4f00-a3b6-d6aa33f3d1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4f2a5d-3e02-44d6-b91f-372af3933ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:00:05 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4f2a5d-3e02-44d6-b91f-372af3933ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297380978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e57a10-fd88-43b6-8a86-f34f000553c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:00:06Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9214c0-05fa-4dfd-a0b8-95bbbddf9cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc9214c0-05fa-4dfd-a0b8-95bbbddf9cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181a031b-542f-4d0f-9cc2-f7706be549cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:00:06 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181a031b-542f-4d0f-9cc2-f7706be549cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e57a10-fd88-43b6-8a86-f34f000553c6', 'volume_name': 'volume-d7e57a10-fd88-43b6-8a86-f34f000553c6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0765d81c-0b96-467a-bd1f-6e305819d847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0765d81c-0b96-467a-bd1f-6e305819d847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2d2deb-eee7-4569-b9f7-333f578efe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:00:06 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Volume d7e57a10-fd88-43b6-8a86-f34f000553c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e57a10-fd88-43b6-8a86-f34f000553c6', 'volume_size': 1} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297380978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e57a10-fd88-43b6-8a86-f34f000553c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:00:06Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Creating volume d7e57a10-fd88-43b6-8a86-f34f000553c6 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:00:06 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.694s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 03:00:06 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 1073741824 Jul 05 03:00:06 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:06 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 1073741824" returned: 0 in 0.793s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:06 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 Jul 05 03:00:06 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:07 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6" returned: 0 in 0.625s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:07 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:00:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:00:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2d2deb-eee7-4569-b9f7-333f578efe98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e57a10-fd88-43b6-8a86-f34f000553c6', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:00:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6449da-87e9-4761-bdf7-806e871b6288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:00:07 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Volume volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 (d7e57a10-fd88-43b6-8a86-f34f000553c6): created successfully Jul 05 03:00:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6449da-87e9-4761-bdf7-806e871b6288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:00:07 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (850c12d2-59b0-4f00-a3b6-d6aa33f3d1e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:00:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-c75205c2-f8f5-4656-b268-f10f1a37c3be tempest-ProjectMemberTests-240412322 None] Created volume successfully. Jul 05 03:00:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:00:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:00:08 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Creating offline snapshot 3458a24f-5b82-4d27-995f-75464df26532 of volume d7e57a10-fd88-43b6-8a86-f34f000553c6 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 03:00:08 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[374a4106-a2b1-4c88-8fc6-21e55a709edf]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:00:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:08 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 Jul 05 03:00:08 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:08 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6" returned: 0 in 0.746s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.3458a24f-5b82-4d27-995f-75464df26532 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:08 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.3458a24f-5b82-4d27-995f-75464df26532 1G Jul 05 03:00:08 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:09 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.3458a24f-5b82-4d27-995f-75464df26532 1G" returned: 0 in 0.778s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.3458a24f-5b82-4d27-995f-75464df26532 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:09 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.3458a24f-5b82-4d27-995f-75464df26532 Jul 05 03:00:09 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:10 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7e57a10-fd88-43b6-8a86-f34f000553c6 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.3458a24f-5b82-4d27-995f-75464df26532" returned: 0 in 0.678s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:10 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.3458a24f-5b82-4d27-995f-75464df26532 is being set with open permissions: ugo+rw Jul 05 03:00:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.3458a24f-5b82-4d27-995f-75464df26532 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:10 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.3458a24f-5b82-4d27-995f-75464df26532 Jul 05 03:00:10 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:11 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.3458a24f-5b82-4d27-995f-75464df26532" returned: 0 in 0.631s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:11 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.info Jul 05 03:00:11 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:11 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.info" returned: 0 in 0.643s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:11 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.info is being set with open permissions: ugo+rw Jul 05 03:00:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:00:11 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.info Jul 05 03:00:11 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:00:12 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 05 03:00:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-d7e57a10-fd88-43b6-8a86-f34f000553c6.info" returned: 0 in 0.632s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:00:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.183s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:00:12 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-aada42db-46ba-4ae5-8a51-1fff025d2c39 tempest-ProjectMemberTests-240412322 None] Create snapshot completed successfully Jul 05 03:00:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-efa6d331-dcf2-4ad0-beaf-14d9963c4463 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-3458a24f-5b82-4d27-995f-75464df26532-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:00:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-efa6d331-dcf2-4ad0-beaf-14d9963c4463 tempest-ProjectMemberTests-240412322 None] Lock "cinder-3458a24f-5b82-4d27-995f-75464df26532-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:00:13 devstack cinder-volume[86671]: INFO cinder.message.api [None req-efa6d331-dcf2-4ad0-beaf-14d9963c4463 tempest-ProjectMemberTests-240412322 None] Creating message record for request_id = req-efa6d331-dcf2-4ad0-beaf-14d9963c4463 Jul 05 03:00:13 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-efa6d331-dcf2-4ad0-beaf-14d9963c4463 tempest-ProjectMemberTests-240412322 None] Lock "cinder-3458a24f-5b82-4d27-995f-75464df26532-delete_snapshot" released by "delete_snapshot" :: held 0.031s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server [None req-efa6d331-dcf2-4ad0-beaf-14d9963c4463 tempest-ProjectMemberTests-240412322 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 221, in wrapper Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1353, in delete_snapshot Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1337, in delete_snapshot Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 03:00:13 devstack cinder-volume[86671]: ERROR oslo_messaging.rpc.server Jul 05 03:00:23 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=45,cinder:UPDATE=60,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:00:23 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=49,cinder:UPDATE=57,cinder:DELETE=6,cinder:INSERT=18 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:01:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:01:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:01:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:01:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:01:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:01:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:01:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:01:05 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:01:05 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:01:05 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 05 03:01:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.626s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:01:05 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:01:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:01:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 03:01:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 03:01:06 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:01:06 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=1 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (0bdc3a58-863c-4d91-a142-485dc9dca1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e119fcae-d0d5-4c65-852d-6eb527c8cbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e119fcae-d0d5-4c65-852d-6eb527c8cbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2091713160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf7c14c-5a2b-420a-a2a6-e0d95d6be309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:01:58Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db91509-a956-4509-bd54-ae7663b7f649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db91509-a956-4509-bd54-ae7663b7f649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558c349f-5ca5-4668-bb32-6bbcca09e99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558c349f-5ca5-4668-bb32-6bbcca09e99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf7c14c-5a2b-420a-a2a6-e0d95d6be309', 'volume_name': 'volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20291b52-89d6-4e7f-aab8-131dcdbe618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20291b52-89d6-4e7f-aab8-131dcdbe618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a65153-9cf2-4124-8c90-ca93d1a5a93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:01:58 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Volume fdf7c14c-5a2b-420a-a2a6-e0d95d6be309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309', 'volume_size': 1} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2091713160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf7c14c-5a2b-420a-a2a6-e0d95d6be309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:01:58Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Creating volume fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:01:58 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:01:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:01:58 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 1073741824 Jul 05 03:01:58 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:01:59 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 05 03:01:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 1073741824" returned: 0 in 0.821s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:01:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:01:59 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 Jul 05 03:01:59 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:00 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" returned: 0 in 0.642s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a65153-9cf2-4124-8c90-ca93d1a5a93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdef5d2-d9ea-4161-b693-e66c50718acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:00 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Volume volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 (fdf7c14c-5a2b-420a-a2a6-e0d95d6be309): created successfully Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdef5d2-d9ea-4161-b693-e66c50718acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (0bdc3a58-863c-4d91-a142-485dc9dca1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:02:00 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-fdca7009-1d84-4c54-828f-c2703f83009e tempest-ProjectReaderTests-82563222 None] Created volume successfully. Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Creating offline snapshot af576e60-30b0-4a91-aa17-9d04a996144d of volume fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda52d07-ec83-4282-8113-713a7631fce2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:00 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 Jul 05 03:02:00 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:01 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" returned: 0 in 0.753s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:01 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d 1G Jul 05 03:02:01 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:02 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d 1G" returned: 0 in 0.765s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:02 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d Jul 05 03:02:02 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:02 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d" returned: 0 in 0.686s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:02 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d is being set with open permissions: ugo+rw Jul 05 03:02:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:02 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d Jul 05 03:02:02 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:03 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d" returned: 0 in 0.633s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:03 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.info Jul 05 03:02:03 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:04 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.info" returned: 0 in 0.649s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:04 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.info is being set with open permissions: ugo+rw Jul 05 03:02:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:04 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.info Jul 05 03:02:04 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:04 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.info" returned: 0 in 0.637s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.195s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:04 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d30ee689-4d71-4f9d-a032-1f479c492aca tempest-ProjectReaderTests-82563222 None] Create snapshot completed successfully Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:05 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:02:05 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-af576e60-30b0-4a91-aa17-9d04a996144d-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Lock "cinder-af576e60-30b0-4a91-aa17-9d04a996144d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-af576e60-30b0-4a91-aa17-9d04a996144d" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-af576e60-30b0-4a91-aa17-9d04a996144d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Deleting offline snapshot af576e60-30b0-4a91-aa17-9d04a996144d of volume fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 03:02:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] snapshot_file for this snap is: volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c371f3c-2300-46f3-9444-b1c76517d142]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:06 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.674s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 03:02:06 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d Jul 05 03:02:06 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:06 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d" returned: 0 in 0.741s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af26f99-e1cd-4098-bf40-3ef59bf2c872]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:06 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 Jul 05 03:02:06 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:07 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" returned: 0 in 0.769s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:07 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d Jul 05 03:02:07 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:08 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d" returned: 0 in 0.710s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:08 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d Jul 05 03:02:08 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:08 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309.af576e60-30b0-4a91-aa17-9d04a996144d" returned: 0 in 0.627s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-af576e60-30b0-4a91-aa17-9d04a996144d" released by "_delete_snapshot" :: held 2.932s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" released by "delete_snapshot" :: held 2.956s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:08 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Created reservations ['54407c3d-01e7-46f8-96eb-e607fec59fe4', '5425f290-d37e-40f5-9ea6-bf185b662139', 'f0db1276-5325-4ddd-a94a-787b322aff9b', '0c66fcda-c9b5-4134-b72f-e23e1cf8dd20'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:02:09 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Delete snapshot completed successfully. Jul 05 03:02:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bf3b3e38-50ed-4193-9f30-dca3d0aa215e tempest-ProjectReaderTests-82563222 None] Lock "cinder-af576e60-30b0-4a91-aa17-9d04a996144d-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Lock "cinder-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:09 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[725ace1c-a0d5-4186-b409-0c820ec7e9c2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:09 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 Jul 05 03:02:09 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:09 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" returned: 0 in 0.741s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:09 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309 Jul 05 03:02:09 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:10 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" returned: 0 in 0.629s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309" released by "delete_volume" :: held 1.423s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:10 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Created reservations ['55a7e077-8bc9-4e0e-8c70-2cddf049cded', '004656a1-832e-4d8e-84cf-568e424a62f5', '30ea8924-c844-4b5b-80f8-33296607b6a4', 'bf0d0a1b-e737-4ea7-9cd5-e7f5e397fe57'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:02:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:02:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:02:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:10 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:02:10 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:11 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.641s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:02:11 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Deleted volume successfully. Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-166b04b4-7604-4bd8-888c-83e0eca6fdc3 tempest-ProjectReaderTests-82563222 None] Lock "cinder-fdf7c14c-5a2b-420a-a2a6-e0d95d6be309-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (bfd1cc4b-3234-4658-8d58-2b42cc65dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86866d2d-100a-475e-b003-67b2c70a999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86866d2d-100a-475e-b003-67b2c70a999f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581306347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3e2618-96ac-4f83-8280-a7f3ef7646b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:02:12Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6dff748-e306-400d-8969-babd26658ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6dff748-e306-400d-8969-babd26658ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659bd2e5-368c-4b65-93be-4a11a013f7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659bd2e5-368c-4b65-93be-4a11a013f7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3e2618-96ac-4f83-8280-a7f3ef7646b4', 'volume_name': 'volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9474184e-8553-4139-98ca-223d7fdedbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9474184e-8553-4139-98ca-223d7fdedbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6829572d-1621-4873-983a-e8acba7cc3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Volume fc3e2618-96ac-4f83-8280-a7f3ef7646b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4', 'volume_size': 1} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581306347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3e2618-96ac-4f83-8280-a7f3ef7646b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:02:12Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Creating volume fc3e2618-96ac-4f83-8280-a7f3ef7646b4 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:02:11 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:02:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:11 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 1073741824 Jul 05 03:02:11 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:12 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 1073741824" returned: 0 in 0.800s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:12 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 Jul 05 03:02:12 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:13 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" returned: 0 in 0.646s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6829572d-1621-4873-983a-e8acba7cc3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8aa3e12-aa15-46ca-bea8-f2aa630fb2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:13 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Volume volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 (fc3e2618-96ac-4f83-8280-a7f3ef7646b4): created successfully Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8aa3e12-aa15-46ca-bea8-f2aa630fb2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (bfd1cc4b-3234-4658-8d58-2b42cc65dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:02:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3b6afae5-1e6b-4f40-b69d-bdefac3c5563 tempest-ProjectReaderTests-82563222 None] Created volume successfully. Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Creating offline snapshot 6c93d844-7a5f-47cf-9c85-26303c2da8a3 of volume fc3e2618-96ac-4f83-8280-a7f3ef7646b4 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd72d871-ecae-488a-ac4a-e9872c116b95]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:14 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 Jul 05 03:02:14 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:14 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" returned: 0 in 0.760s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:14 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 1G Jul 05 03:02:14 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:15 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 1G" returned: 0 in 0.780s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:15 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 Jul 05 03:02:15 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:16 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3" returned: 0 in 0.673s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:16 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 is being set with open permissions: ugo+rw Jul 05 03:02:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:16 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 Jul 05 03:02:16 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:16 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3" returned: 0 in 0.650s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:16 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.info Jul 05 03:02:16 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:17 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.info" returned: 0 in 0.658s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:17 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.info is being set with open permissions: ugo+rw Jul 05 03:02:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:17 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.info Jul 05 03:02:17 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:18 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.info" returned: 0 in 0.632s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.228s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-320d20e6-5e1f-49e1-9a83-be3879905dc1 tempest-ProjectReaderTests-82563222 None] Create snapshot completed successfully Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-6c93d844-7a5f-47cf-9c85-26303c2da8a3-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Lock "cinder-6c93d844-7a5f-47cf-9c85-26303c2da8a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-6c93d844-7a5f-47cf-9c85-26303c2da8a3" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-6c93d844-7a5f-47cf-9c85-26303c2da8a3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Deleting offline snapshot 6c93d844-7a5f-47cf-9c85-26303c2da8a3 of volume fc3e2618-96ac-4f83-8280-a7f3ef7646b4 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] snapshot_file for this snap is: volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f2d35a-49c5-4b8e-a85e-37574c9eee84]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:19 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 Jul 05 03:02:19 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:19 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3" returned: 0 in 0.737s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:02:20 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b17e1a-1610-4516-b9b1-f14d8e97e749]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:20 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 Jul 05 03:02:20 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:20 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" returned: 0 in 0.735s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:20 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 Jul 05 03:02:20 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:21 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3" returned: 0 in 0.710s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:21 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3 Jul 05 03:02:21 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:22 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4.6c93d844-7a5f-47cf-9c85-26303c2da8a3" returned: 0 in 0.663s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-6c93d844-7a5f-47cf-9c85-26303c2da8a3" released by "_delete_snapshot" :: held 2.929s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" released by "delete_snapshot" :: held 2.950s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Created reservations ['1ff2a160-9678-49d4-a66b-a13cd747d5da', 'ec77c53d-4a17-4b6b-bf61-dee7ed516a34', '8859d20d-b6f0-4a03-a898-0b30e7b27732', 'c6e216aa-b705-485c-89d3-99da972205f2'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:02:22 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Delete snapshot completed successfully. Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-bbf40d96-dd48-4d7c-8782-9f8058b6a466 tempest-ProjectReaderTests-82563222 None] Lock "cinder-6c93d844-7a5f-47cf-9c85-26303c2da8a3-delete_snapshot" released by "delete_snapshot" :: held 3.077s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-fc3e2618-96ac-4f83-8280-a7f3ef7646b4-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Lock "cinder-fc3e2618-96ac-4f83-8280-a7f3ef7646b4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bbe7d9-babf-42fa-895e-a0e2299c0856]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:22 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 Jul 05 03:02:22 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:23 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" returned: 0 in 0.753s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:23 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4 Jul 05 03:02:23 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:23 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" returned: 0 in 0.643s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-fc3e2618-96ac-4f83-8280-a7f3ef7646b4" released by "delete_volume" :: held 1.459s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Created reservations ['4e2ee454-a667-46f2-920b-d41ae1a6467f', '690b166a-57c0-4cfd-82e8-67bd558db02a', '0dbaa8ff-f8c2-49b9-b586-21bd7a574efd', '54beb6bf-1c2a-474a-a594-480680ae82eb'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:24 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:02:24 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:24 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.664s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:24 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:02:24 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Deleted volume successfully. Jul 05 03:02:24 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-434fa77e-f70c-4867-9e6a-48f441e6e057 tempest-ProjectReaderTests-82563222 None] Lock "cinder-fc3e2618-96ac-4f83-8280-a7f3ef7646b4-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:24 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (a751fab9-0c15-4283-a51a-72afbe89da08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e4e06a-eab2-4a18-b900-2f86b5ee04f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e4e06a-eab2-4a18-b900-2f86b5ee04f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64809993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d337991-b946-410a-a70d-8f13975399fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:02:25Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02e4840-58e3-4f73-8360-c49738e70115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02e4840-58e3-4f73-8360-c49738e70115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a704bf7-2ad0-49b2-9bb5-aa92888a378c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a704bf7-2ad0-49b2-9bb5-aa92888a378c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d337991-b946-410a-a70d-8f13975399fd', 'volume_name': 'volume-4d337991-b946-410a-a70d-8f13975399fd', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95320d10-be04-4d1d-b7b8-9ddfb181de13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95320d10-be04-4d1d-b7b8-9ddfb181de13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0cc7aff-c61e-4c96-9550-f41effc2012a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:25 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Volume 4d337991-b946-410a-a70d-8f13975399fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d337991-b946-410a-a70d-8f13975399fd', 'volume_size': 1} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64809993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d337991-b946-410a-a70d-8f13975399fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cd80164b2b4e409720c9d379487270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:02:25Z,use_quota=True,user_id='a8ac273c2c3d44e8aa94a316a65c18f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Creating volume 4d337991-b946-410a-a70d-8f13975399fd {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:02:25 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:25 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd 1073741824 Jul 05 03:02:25 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:25 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd 1073741824" returned: 0 in 0.787s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:25 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd Jul 05 03:02:25 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:26 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd" returned: 0 in 0.644s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:02:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0cc7aff-c61e-4c96-9550-f41effc2012a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d337991-b946-410a-a70d-8f13975399fd', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff722fb9-ce1e-417e-83fc-f6ca464899fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:26 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Volume volume-4d337991-b946-410a-a70d-8f13975399fd (4d337991-b946-410a-a70d-8f13975399fd): created successfully Jul 05 03:02:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff722fb9-ce1e-417e-83fc-f6ca464899fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:26 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Flow 'volume_create_manager' (a751fab9-0c15-4283-a51a-72afbe89da08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:02:26 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-82bce843-7a5d-4bbe-bad8-25fff5142d2f tempest-ProjectReaderTests-82563222 None] Created volume successfully. Jul 05 03:02:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:27 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Creating offline snapshot f249a56a-5a48-4eaa-ad23-90e82940c1d9 of volume 4d337991-b946-410a-a70d-8f13975399fd {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 03:02:27 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[665514b0-2118-4357-9780-3894fa05169e]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:27 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd Jul 05 03:02:27 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:27 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd" returned: 0 in 0.740s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:28 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 1G Jul 05 03:02:28 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:28 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 1G" returned: 0 in 0.772s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d337991-b946-410a-a70d-8f13975399fd -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:28 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d337991-b946-410a-a70d-8f13975399fd -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 Jul 05 03:02:28 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:29 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d337991-b946-410a-a70d-8f13975399fd -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9" returned: 0 in 0.682s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:29 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 is being set with open permissions: ugo+rw Jul 05 03:02:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:29 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 Jul 05 03:02:29 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:30 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9" returned: 0 in 0.621s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:30 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.info Jul 05 03:02:30 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:30 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.info" returned: 0 in 0.621s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:30 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.info is being set with open permissions: ugo+rw Jul 05 03:02:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:30 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.info Jul 05 03:02:30 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:31 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.info" returned: 0 in 0.636s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.147s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-720ddce0-b909-4569-9a14-b2ffd3a84002 tempest-ProjectReaderTests-82563222 None] Create snapshot completed successfully Jul 05 03:02:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-f249a56a-5a48-4eaa-ad23-90e82940c1d9-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Lock "cinder-f249a56a-5a48-4eaa-ad23-90e82940c1d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-4d337991-b946-410a-a70d-8f13975399fd" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-4d337991-b946-410a-a70d-8f13975399fd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-f249a56a-5a48-4eaa-ad23-90e82940c1d9" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:32 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-f249a56a-5a48-4eaa-ad23-90e82940c1d9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Deleting offline snapshot f249a56a-5a48-4eaa-ad23-90e82940c1d9 of volume 4d337991-b946-410a-a70d-8f13975399fd {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 03:02:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] snapshot_file for this snap is: volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 03:02:32 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a7949b-23df-41a4-b7e5-c8ea73d002e4]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:32 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 Jul 05 03:02:32 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:33 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9" returned: 0 in 0.737s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d337991-b946-410a-a70d-8f13975399fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:02:33 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[459d43d9-d523-4f0d-b352-06916552b378]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:33 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd Jul 05 03:02:33 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:33 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd" returned: 0 in 0.730s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:34 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 Jul 05 03:02:34 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:34 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9" returned: 0 in 0.718s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:34 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9 Jul 05 03:02:34 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:35 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd.f249a56a-5a48-4eaa-ad23-90e82940c1d9" returned: 0 in 0.626s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-f249a56a-5a48-4eaa-ad23-90e82940c1d9" released by "_delete_snapshot" :: held 2.899s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-4d337991-b946-410a-a70d-8f13975399fd" released by "delete_snapshot" :: held 2.925s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Created reservations ['63d7b63d-05cf-440b-9ce7-1699569004c2', '22b177c8-e043-401c-9521-d6bb13ed2572', '13addc22-b78e-4cf0-8fbb-aaf19d2316cf', 'e879e103-3e7e-4e10-9d3b-c670ed8e6a14'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:02:35 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Delete snapshot completed successfully. Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-10672cbd-4ee3-4644-8c7e-cad762d320e6 tempest-ProjectReaderTests-82563222 None] Lock "cinder-f249a56a-5a48-4eaa-ad23-90e82940c1d9-delete_snapshot" released by "delete_snapshot" :: held 3.055s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-4d337991-b946-410a-a70d-8f13975399fd-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Lock "cinder-4d337991-b946-410a-a70d-8f13975399fd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Acquiring lock "cinder-quobyte-4d337991-b946-410a-a70d-8f13975399fd" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-4d337991-b946-410a-a70d-8f13975399fd" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6583c2c-b68e-4ecb-814c-bb40d57447c5]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:36 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd Jul 05 03:02:36 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:36 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd" returned: 0 in 0.753s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:36 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd Jul 05 03:02:36 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:37 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4d337991-b946-410a-a70d-8f13975399fd" returned: 0 in 0.634s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Lock "cinder-quobyte-4d337991-b946-410a-a70d-8f13975399fd" released by "delete_volume" :: held 1.441s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:37 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Created reservations ['5dca11e2-ffa8-400c-9bf2-c678ef6ba093', '268fcccd-6971-4cb6-9a91-eccdba435eba', 'acdde850-fbe7-402e-a51f-536fe3c69fad', '04636d09-a59f-489e-84a8-bd605eeaf319'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:02:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:02:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:02:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:37 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:02:37 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:38 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.628s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:38 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:02:38 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Deleted volume successfully. Jul 05 03:02:38 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-023ce258-c989-4b96-ae61-4b620e5cc9bb tempest-ProjectReaderTests-82563222 None] Lock "cinder-4d337991-b946-410a-a70d-8f13975399fd-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Flow 'volume_create_manager' (4c6822cc-b6ad-4907-bf01-4955f33e4043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9508739e-aff9-447b-bc62-ff8d1b3a4c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9508739e-aff9-447b-bc62-ff8d1b3a4c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844848455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedf766d-9cca-4da8-83d3-925d119c26e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c26f53672a4c9e943ddc78c3ef0ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:02:42Z,use_quota=True,user_id='4c24a5f5908d47d09c305cf26d20cb6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a410293-aeb5-456c-8e10-4958df190384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a410293-aeb5-456c-8e10-4958df190384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b58e77-5c31-4507-85b0-60871d56b069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b58e77-5c31-4507-85b0-60871d56b069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fedf766d-9cca-4da8-83d3-925d119c26e8', 'volume_name': 'volume-fedf766d-9cca-4da8-83d3-925d119c26e8', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92140f9a-fe6f-4d7c-b278-478797723061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92140f9a-fe6f-4d7c-b278-478797723061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43163a1d-8972-4a15-958c-c4952d6935b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:41 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Volume fedf766d-9cca-4da8-83d3-925d119c26e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fedf766d-9cca-4da8-83d3-925d119c26e8', 'volume_size': 1} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844848455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedf766d-9cca-4da8-83d3-925d119c26e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c26f53672a4c9e943ddc78c3ef0ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:02:42Z,use_quota=True,user_id='4c24a5f5908d47d09c305cf26d20cb6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Creating volume fedf766d-9cca-4da8-83d3-925d119c26e8 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:02:41 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:02:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:41 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8 1073741824 Jul 05 03:02:41 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:42 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8 1073741824" returned: 0 in 0.786s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:42 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8 Jul 05 03:02:42 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:43 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8" returned: 0 in 0.620s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43163a1d-8972-4a15-958c-c4952d6935b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedf766d-9cca-4da8-83d3-925d119c26e8', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163d56dc-ef8d-458b-93f5-9c005500aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:43 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Volume volume-fedf766d-9cca-4da8-83d3-925d119c26e8 (fedf766d-9cca-4da8-83d3-925d119c26e8): created successfully Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (163d56dc-ef8d-458b-93f5-9c005500aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Flow 'volume_create_manager' (4c6822cc-b6ad-4907-bf01-4955f33e4043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:02:43 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d94ba416-d86f-4be9-b6b3-8bf90df7d7a0 tempest-ProjectReaderTests-394903215 None] Created volume successfully. Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Acquiring lock "cinder-fedf766d-9cca-4da8-83d3-925d119c26e8-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Lock "cinder-fedf766d-9cca-4da8-83d3-925d119c26e8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Acquiring lock "cinder-quobyte-fedf766d-9cca-4da8-83d3-925d119c26e8" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Lock "cinder-quobyte-fedf766d-9cca-4da8-83d3-925d119c26e8" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8fc12b-148f-48ec-a60b-c9e88cea3023]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:44 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8 Jul 05 03:02:44 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:44 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8" returned: 0 in 0.718s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:44 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8 Jul 05 03:02:44 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:45 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-fedf766d-9cca-4da8-83d3-925d119c26e8" returned: 0 in 0.620s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:45 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Lock "cinder-quobyte-fedf766d-9cca-4da8-83d3-925d119c26e8" released by "delete_volume" :: held 1.374s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:45 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Created reservations ['fef578cc-d6e7-4c66-9cc8-f04fd8e32e08', 'a1ce9d58-d055-4717-b199-bbbb612282b9', '376b8912-bbd0-4326-ba75-07dd8845829a', '3cc0b382-d3e2-4fd8-bda5-c8ecc2745d4f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:02:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:02:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:02:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:45 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:02:45 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:46 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.617s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:02:46 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Deleted volume successfully. Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-8270c2a6-41ea-4ec0-a8ad-9fceb43d839a tempest-ProjectReaderTests-394903215 None] Lock "cinder-fedf766d-9cca-4da8-83d3-925d119c26e8-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Flow 'volume_create_manager' (c94117c5-427c-43a7-867b-97746e170601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1146564-c52a-4bd9-8faa-16011e0c253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1146564-c52a-4bd9-8faa-16011e0c253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1886309457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f291037-f6c1-4c16-9c57-54c1d81f5ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c26f53672a4c9e943ddc78c3ef0ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:02:46Z,use_quota=True,user_id='4c24a5f5908d47d09c305cf26d20cb6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0606dfaa-fae3-4625-83cd-38505f5aba2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0606dfaa-fae3-4625-83cd-38505f5aba2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c76cba-cf4f-4fbd-a55e-bca39176cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c76cba-cf4f-4fbd-a55e-bca39176cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f291037-f6c1-4c16-9c57-54c1d81f5ca9', 'volume_name': 'volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (841ca121-870e-4103-9eb4-0b406eaa772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (841ca121-870e-4103-9eb4-0b406eaa772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bb3d8f-b98c-4a06-9eeb-cedcb188edf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:46 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Volume 4f291037-f6c1-4c16-9c57-54c1d81f5ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9', 'volume_size': 1} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1886309457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f291037-f6c1-4c16-9c57-54c1d81f5ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c26f53672a4c9e943ddc78c3ef0ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:02:46Z,use_quota=True,user_id='4c24a5f5908d47d09c305cf26d20cb6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Creating volume 4f291037-f6c1-4c16-9c57-54c1d81f5ca9 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:02:46 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:02:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:46 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9 1073741824 Jul 05 03:02:46 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:47 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9 1073741824" returned: 0 in 0.779s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:47 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9 Jul 05 03:02:47 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:48 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9" returned: 0 in 0.646s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bb3d8f-b98c-4a06-9eeb-cedcb188edf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4861ba9f-bdd0-49d6-bab1-5978221773cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:02:48 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Volume volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9 (4f291037-f6c1-4c16-9c57-54c1d81f5ca9): created successfully Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4861ba9f-bdd0-49d6-bab1-5978221773cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Flow 'volume_create_manager' (c94117c5-427c-43a7-867b-97746e170601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:02:48 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-70b36294-19cc-4042-a5c6-181b6d2b7fee tempest-ProjectReaderTests-394903215 None] Created volume successfully. Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Acquiring lock "cinder-4f291037-f6c1-4c16-9c57-54c1d81f5ca9-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Lock "cinder-4f291037-f6c1-4c16-9c57-54c1d81f5ca9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Acquiring lock "cinder-quobyte-4f291037-f6c1-4c16-9c57-54c1d81f5ca9" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Lock "cinder-quobyte-4f291037-f6c1-4c16-9c57-54c1d81f5ca9" acquired by "delete_volume" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd599db1-a215-4fc5-97bf-37607deb43a2]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:02:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:48 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9 Jul 05 03:02:48 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:49 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9" returned: 0 in 0.736s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:49 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9 Jul 05 03:02:49 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:50 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-4f291037-f6c1-4c16-9c57-54c1d81f5ca9" returned: 0 in 0.647s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Lock "cinder-quobyte-4f291037-f6c1-4c16-9c57-54c1d81f5ca9" released by "delete_volume" :: held 1.422s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Created reservations ['7f57f980-4792-4049-b113-ac35e4a9a153', '3368cabf-1607-4866-af29-4b9c6255b435', 'bfa29e74-1709-44d2-ae2d-d28ade2dfa25', '26b7433e-deca-4941-8e4d-0b21cf85ddf3'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:02:50 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:02:50 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:02:50 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.621s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:02:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Deleted volume successfully. Jul 05 03:02:50 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-5d1cbf52-16e1-40c5-ad28-39919164efd9 tempest-ProjectReaderTests-394903215 None] Lock "cinder-4f291037-f6c1-4c16-9c57-54c1d81f5ca9-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:03:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:05 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:03:05 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:06 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.663s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:03:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:03:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 03:03:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 03:03:06 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=77,cinder:SELECT=55,cinder:INSERT=20,cinder:DELETE=8 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:03:06 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=58,cinder:UPDATE=76,cinder:DELETE=5,cinder:INSERT=20 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Flow 'volume_create_manager' (bb74de6b-39d9-4389-af7c-06a1475f7181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5804439-a47a-44d4-ad0a-1da0cdcc87ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5804439-a47a-44d4-ad0a-1da0cdcc87ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-329945709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ab0440-2f94-4773-99ec-2ddb8ce8aecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b969de135a146b4a8ff3a57f6920902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:03:12Z,use_quota=True,user_id='14ec627e73b146acb10a6097c83931e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40574fd-7e70-4e18-947a-7fd492d26638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40574fd-7e70-4e18-947a-7fd492d26638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93107b28-b93a-4dbc-8fca-f4dbedb1a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93107b28-b93a-4dbc-8fca-f4dbedb1a955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ab0440-2f94-4773-99ec-2ddb8ce8aecc', 'volume_name': 'volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694e31cd-b272-417f-8b30-5da7b650a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694e31cd-b272-417f-8b30-5da7b650a334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cfe2da-302d-4334-90a7-4423321d7350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:11 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Volume 82ab0440-2f94-4773-99ec-2ddb8ce8aecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc', 'volume_size': 1} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-329945709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ab0440-2f94-4773-99ec-2ddb8ce8aecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b969de135a146b4a8ff3a57f6920902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:03:12Z,use_quota=True,user_id='14ec627e73b146acb10a6097c83931e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Creating volume 82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:03:11 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:03:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:11 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc 1073741824 Jul 05 03:03:11 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:12 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc 1073741824" returned: 0 in 0.791s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:12 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc Jul 05 03:03:12 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:13 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" returned: 0 in 0.620s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:03:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cfe2da-302d-4334-90a7-4423321d7350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba63a749-ebe6-42ce-802f-f5d9b9382cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:13 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Volume volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc (82ab0440-2f94-4773-99ec-2ddb8ce8aecc): created successfully Jul 05 03:03:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba63a749-ebe6-42ce-802f-f5d9b9382cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:13 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Flow 'volume_create_manager' (bb74de6b-39d9-4389-af7c-06a1475f7181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:03:13 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-788748b7-4dad-4f32-9602-ccd6197b4e17 tempest-SnapshotDependencyTests-668032457 None] Created volume successfully. Jul 05 03:03:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:14 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Creating offline snapshot 1e3c0455-ec27-4ee7-91cc-5932b16d1e77 of volume 82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 03:03:14 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b45cce-8466-4d91-85a9-edaa4b92ef15]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:14 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc Jul 05 03:03:14 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:14 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" returned: 0 in 0.770s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:14 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 1G Jul 05 03:03:14 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:15 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 1G" returned: 0 in 0.789s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:15 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 Jul 05 03:03:15 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:16 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77" returned: 0 in 0.681s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:16 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 is being set with open permissions: ugo+rw Jul 05 03:03:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:16 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 Jul 05 03:03:16 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:16 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77" returned: 0 in 0.639s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:17 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.info Jul 05 03:03:17 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:17 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.info" returned: 0 in 0.641s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:17 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.info is being set with open permissions: ugo+rw Jul 05 03:03:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:17 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.info Jul 05 03:03:17 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:18 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.info" returned: 0 in 0.622s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.223s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:18 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-459cf103-cc76-4447-911a-6243dbf9fa30 tempest-SnapshotDependencyTests-668032457 None] Create snapshot completed successfully Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Flow 'volume_create_manager' (802bec7b-6db9-4ce3-8f59-c50aef7d83bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1a5155-6e74-4da0-bff2-8aaeb33818e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae1a5155-6e74-4da0-bff2-8aaeb33818e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d88d0aa-f08d-4fa5-b652-86b4c7178aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b969de135a146b4a8ff3a57f6920902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e3c0455-ec27-4ee7-91cc-5932b16d1e77,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:03:20Z,use_quota=True,user_id='14ec627e73b146acb10a6097c83931e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c16b11-400f-44fd-b212-6ff6752304d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c16b11-400f-44fd-b212-6ff6752304d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66b7da2-6cb5-48b3-b059-3ea1f1cafd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66b7da2-6cb5-48b3-b059-3ea1f1cafd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d88d0aa-f08d-4fa5-b652-86b4c7178aea', 'volume_name': 'volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea', 'volume_size': 1, 'snapshot_id': '1e3c0455-ec27-4ee7-91cc-5932b16d1e77'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506514fc-8d93-451e-8238-e45f3c4862ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506514fc-8d93-451e-8238-e45f3c4862ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f332531-c4a7-4ec6-8d3e-fd3a70a7b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:19 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Volume 5d88d0aa-f08d-4fa5-b652-86b4c7178aea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea', 'volume_size': 1, 'snapshot_id': '1e3c0455-ec27-4ee7-91cc-5932b16d1e77'} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "cinder-quobyte-1e3c0455-ec27-4ee7-91cc-5932b16d1e77-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" by "_create_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-1e3c0455-ec27-4ee7-91cc-5932b16d1e77-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Creating volume 5d88d0aa-f08d-4fa5-b652-86b4c7178aea from snapshot 1e3c0455-ec27-4ee7-91cc-5932b16d1e77 {{(pid=86671) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "cinder-quobyte-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" by "_copy_volume_from_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] snapshot: 1e3c0455-ec27-4ee7-91cc-5932b16d1e77, volume: 5d88d0aa-f08d-4fa5-b652-86b4c7178aea, {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4615c77-851a-4f47-b06b-45fca3cd0953]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:20 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 Jul 05 03:03:20 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:20 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77" returned: 0 in 0.732s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:03:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 03:03:20 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Creating direct copy from snapshot {{(pid=86671) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 03:03:20 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fce72a-b544-4d05-a641-9359b9a27268]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:20 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc Jul 05 03:03:20 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:21 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" returned: 0 in 0.725s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:21 devstack cinder-volume[86671]: DEBUG cinder.utils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Path /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea not found in is_blk_device check {{(pid=86671) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 03:03:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:21 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea Jul 05 03:03:21 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:25 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" returned: 0 in 4.376s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:25 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc781e5-d355-4181-8bdc-2dc6296b6f42]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:25 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc Jul 05 03:03:25 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:26 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" returned: 0 in 0.901s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:26 devstack cinder-volume[86671]: DEBUG cinder.image.image_utils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Image conversion details: src /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea {{(pid=86671) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 03:03:26 devstack cinder-volume[86671]: INFO cinder.image.image_utils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Converted 1024.00 MB image at 233.96 MB/s Jul 05 03:03:26 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea is being set with open permissions: ugo+rw Jul 05 03:03:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:26 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea Jul 05 03:03:26 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:27 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" returned: 0 in 0.610s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" released by "_copy_volume_from_snapshot" :: held 7.427s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:27 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-1e3c0455-ec27-4ee7-91cc-5932b16d1e77-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" released by "_create_volume_from_snapshot" :: held 7.454s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.467s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f332531-c4a7-4ec6-8d3e-fd3a70a7b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea', 'volume_size': 1, 'snapshot_id': '1e3c0455-ec27-4ee7-91cc-5932b16d1e77'}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc87273b-e237-4cc3-acc8-8d9a62b25d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:27 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Volume volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea (5d88d0aa-f08d-4fa5-b652-86b4c7178aea): created successfully Jul 05 03:03:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc87273b-e237-4cc3-acc8-8d9a62b25d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:27 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Flow 'volume_create_manager' (802bec7b-6db9-4ce3-8f59-c50aef7d83bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:03:27 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-99e0c7c5-31ab-49bc-b3c6-2337962e0035 tempest-SnapshotDependencyTests-668032457 None] Created volume successfully. Jul 05 03:03:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "cinder-1e3c0455-ec27-4ee7-91cc-5932b16d1e77-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-1e3c0455-ec27-4ee7-91cc-5932b16d1e77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "cinder-quobyte-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "cinder-quobyte-1e3c0455-ec27-4ee7-91cc-5932b16d1e77" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:28 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-1e3c0455-ec27-4ee7-91cc-5932b16d1e77" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Deleting offline snapshot 1e3c0455-ec27-4ee7-91cc-5932b16d1e77 of volume 82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 03:03:28 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] snapshot_file for this snap is: volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 03:03:28 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40afca9-72d4-444f-b9df-520602692525]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:28 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 Jul 05 03:03:28 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:29 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77" returned: 0 in 0.741s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[540112df-41c7-4ba7-8ee1-dcb2f3e8ca5d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:29 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc Jul 05 03:03:29 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (2b77e66b-9bb6-4ce8-8aa0-484f875e9f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a98a6ad-b96d-49cc-a63a-3ebe82a37297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a98a6ad-b96d-49cc-a63a-3ebe82a37297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575556976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d80b79a-6aa4-4c41-aaa8-0d737814dc29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:03:30Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d600a0-35dc-4099-8db8-2381a6d8d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d600a0-35dc-4099-8db8-2381a6d8d212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa1ba55-5cc7-47a3-8484-000a7efbbeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa1ba55-5cc7-47a3-8484-000a7efbbeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d80b79a-6aa4-4c41-aaa8-0d737814dc29', 'volume_name': 'volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427c7236-d6ff-42cb-a56c-0ade395df93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427c7236-d6ff-42cb-a56c-0ade395df93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689f6245-d332-4a59-aa42-e2a482c324be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:29 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Volume 6d80b79a-6aa4-4c41-aaa8-0d737814dc29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29', 'volume_size': 1} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575556976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d80b79a-6aa4-4c41-aaa8-0d737814dc29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:03:30Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Creating volume 6d80b79a-6aa4-4c41-aaa8-0d737814dc29 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:03:29 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:03:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:29 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 1073741824 Jul 05 03:03:29 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:30 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" returned: 0 in 0.769s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:30 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 Jul 05 03:03:30 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:30 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 1073741824" returned: 0 in 0.820s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:30 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 Jul 05 03:03:30 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:30 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77" returned: 0 in 0.724s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:30 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77 Jul 05 03:03:30 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:31 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" returned: 0 in 0.641s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689f6245-d332-4a59-aa42-e2a482c324be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0c5761-3a59-4be3-a9b4-9973eb9d6a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:31 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Volume volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 (6d80b79a-6aa4-4c41-aaa8-0d737814dc29): created successfully Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0c5761-3a59-4be3-a9b4-9973eb9d6a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (2b77e66b-9bb6-4ce8-8aa0-484f875e9f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:03:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-9cfafd0c-c6f0-4b5d-8180-f316d6e72e94 tempest-ProjectMemberTests-240412322 None] Created volume successfully. Jul 05 03:03:31 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc.1e3c0455-ec27-4ee7-91cc-5932b16d1e77" returned: 0 in 0.642s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-1e3c0455-ec27-4ee7-91cc-5932b16d1e77" released by "_delete_snapshot" :: held 2.966s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" released by "delete_snapshot" :: held 2.986s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Created reservations ['646da15b-ed0d-4963-afcb-1b162e085542', '19207c78-f30e-4e55-a499-696b4fee0f58', '3f7777a6-ec5e-4e39-912e-789ef9fc3d7d', 'dcadf860-f75e-49f1-8c1d-fd6ff9182bca'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:03:31 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Delete snapshot completed successfully. Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-0e4c8b93-7618-41ad-b68e-f447ee6d1b12 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-1e3c0455-ec27-4ee7-91cc-5932b16d1e77-delete_snapshot" released by "delete_snapshot" :: held 3.109s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "cinder-82ab0440-2f94-4773-99ec-2ddb8ce8aecc-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-82ab0440-2f94-4773-99ec-2ddb8ce8aecc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "cinder-quobyte-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[541830ba-fd07-4d84-81d2-f8b7ebc1a692]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:31 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc Jul 05 03:03:31 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Creating offline snapshot 277d60c5-b46e-4869-b929-fc0c535724ce of volume 6d80b79a-6aa4-4c41-aaa8-0d737814dc29 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9301d10-6798-42f4-bdf2-379802308973]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:32 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 Jul 05 03:03:32 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:32 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" returned: 0 in 0.773s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:32 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc Jul 05 03:03:32 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:32 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" returned: 0 in 0.759s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:32 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce 1G Jul 05 03:03:32 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:33 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" returned: 0 in 0.640s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-82ab0440-2f94-4773-99ec-2ddb8ce8aecc" released by "delete_volume" :: held 1.489s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Created reservations ['75b1f332-e074-4314-8650-5506af837c8d', 'cc7b27c9-0cb2-430a-b163-7ba960fabc86', '84a1996e-55cd-460b-94e0-3f361f4a32fb', '6c2b10c8-5df2-49cb-a285-c3ad0dd2d0e8'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:33 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:03:33 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:33 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce 1G" returned: 0 in 0.847s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:33 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce Jul 05 03:03:33 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "cinder-5d88d0aa-f08d-4fa5-b652-86b4c7178aea-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:33 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-5d88d0aa-f08d-4fa5-b652-86b4c7178aea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "cinder-quobyte-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" acquired by "delete_volume" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d2277d-c661-4cb5-95ce-60a07f461742]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:34 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.702s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:03:34 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Deleted volume successfully. Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-136f6121-abf6-4ee6-a041-fde0df975379 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-82ab0440-2f94-4773-99ec-2ddb8ce8aecc-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:34 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea Jul 05 03:03:34 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:34 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce" returned: 0 in 0.712s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:34 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce is being set with open permissions: ugo+rw Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:34 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce Jul 05 03:03:34 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:34 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" returned: 0 in 0.773s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:34 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea Jul 05 03:03:34 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:34 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce" returned: 0 in 0.653s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:35 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.info Jul 05 03:03:35 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:35 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" returned: 0 in 0.633s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-quobyte-5d88d0aa-f08d-4fa5-b652-86b4c7178aea" released by "delete_volume" :: held 1.461s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Created reservations ['43f3acdc-6f8a-4cd6-8276-7ec69ba0e729', 'e6442e85-40b6-40c8-91b4-3709af52e50e', '1fa6276b-ec61-4d8e-a9fb-3c15e5e51204', 'bbf40134-8e73-4712-a087-4330dc64b0fe'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:35 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:03:35 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:35 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.info" returned: 0 in 0.664s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:35 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.info is being set with open permissions: ugo+rw Jul 05 03:03:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:35 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.info Jul 05 03:03:35 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:36 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.664s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:36 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:03:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Deleted volume successfully. Jul 05 03:03:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-f9c7435b-1f37-4735-8fc7-988319530a02 tempest-SnapshotDependencyTests-668032457 None] Lock "cinder-5d88d0aa-f08d-4fa5-b652-86b4c7178aea-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:36 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.info" returned: 0 in 0.660s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.396s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:36 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d34ddeb3-43f9-4145-aca7-314e7cd5d076 tempest-ProjectMemberTests-240412322 None] Create snapshot completed successfully Jul 05 03:03:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-277d60c5-b46e-4869-b929-fc0c535724ce-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Lock "cinder-277d60c5-b46e-4869-b929-fc0c535724ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-277d60c5-b46e-4869-b929-fc0c535724ce" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-277d60c5-b46e-4869-b929-fc0c535724ce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Deleting offline snapshot 277d60c5-b46e-4869-b929-fc0c535724ce of volume 6d80b79a-6aa4-4c41-aaa8-0d737814dc29 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 03:03:37 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] snapshot_file for this snap is: volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 03:03:37 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f7319a-64e0-4e30-80c3-c6a94bbf01d7]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:37 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce Jul 05 03:03:37 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:38 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce" returned: 0 in 0.803s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:38 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:03:38 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee83b07-89eb-4cbf-bf21-ea166a4a5262]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:38 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 Jul 05 03:03:38 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:38 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" returned: 0 in 0.838s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:38 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:39 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce Jul 05 03:03:39 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:39 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce" returned: 0 in 0.857s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:39 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:39 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce Jul 05 03:03:39 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:40 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:40 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29.277d60c5-b46e-4869-b929-fc0c535724ce" returned: 0 in 0.660s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-277d60c5-b46e-4869-b929-fc0c535724ce" released by "_delete_snapshot" :: held 3.265s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" released by "delete_snapshot" :: held 3.288s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:40 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Created reservations ['6d3845e5-c8ae-45ae-9bd7-3e39b8e47128', 'd96c886a-f273-4faf-9ff1-2a61c4669a65', '06b10e64-f7e4-4c15-ba1e-f49840e7a7eb', '353de396-9199-4ecc-b1e6-00727cee4b5a'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:03:40 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Delete snapshot completed successfully. Jul 05 03:03:40 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-3f8af1ae-b700-4255-a755-43a23c679b2b tempest-ProjectMemberTests-240412322 None] Lock "cinder-277d60c5-b46e-4869-b929-fc0c535724ce-delete_snapshot" released by "delete_snapshot" :: held 3.424s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-6d80b79a-6aa4-4c41-aaa8-0d737814dc29-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Lock "cinder-6d80b79a-6aa4-4c41-aaa8-0d737814dc29-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:41 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:41 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1345eab-4d0e-4fd5-a2d0-e980de87c01a]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:41 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:41 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 Jul 05 03:03:41 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:42 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" returned: 0 in 0.810s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:42 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:42 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29 Jul 05 03:03:42 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:43 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" returned: 0 in 0.684s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:43 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-6d80b79a-6aa4-4c41-aaa8-0d737814dc29" released by "delete_volume" :: held 1.569s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:43 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Created reservations ['fa299a9d-53b4-4f0f-8608-8a1c4d91a1a5', 'f57b66c6-e5e7-4cd7-bf95-b65a5184bbc1', '58593aef-126f-44fc-a954-261c11ef44fe', 'cd4cfd5f-cdf4-41e3-9733-29ad8c1bb4e0'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:03:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:43 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:43 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:43 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:03:43 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:44 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.780s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:03:44 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Deleted volume successfully. Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff292752-5573-43b8-ba5f-565e4daa601c tempest-ProjectMemberTests-240412322 None] Lock "cinder-6d80b79a-6aa4-4c41-aaa8-0d737814dc29-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (53d71daf-7e1f-4693-9ca7-602a164a0d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f43076-0019-47af-bf8c-ac520e186063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f43076-0019-47af-bf8c-ac520e186063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471828449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bab463-0cd7-459a-860b-4abdae95f105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:03:44Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333625dd-6772-4ac1-9f2e-067ce3935394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (333625dd-6772-4ac1-9f2e-067ce3935394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20af6dc-74da-44f2-b3c3-b251228313f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20af6dc-74da-44f2-b3c3-b251228313f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7bab463-0cd7-459a-860b-4abdae95f105', 'volume_name': 'volume-c7bab463-0cd7-459a-860b-4abdae95f105', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f265e7-d1a9-41f1-8030-e97ba4dd9034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f265e7-d1a9-41f1-8030-e97ba4dd9034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48d9f5e-b4a9-4cb7-a69e-a049b3210949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:44 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Volume c7bab463-0cd7-459a-860b-4abdae95f105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7bab463-0cd7-459a-860b-4abdae95f105', 'volume_size': 1} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471828449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bab463-0cd7-459a-860b-4abdae95f105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:03:44Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Creating volume c7bab463-0cd7-459a-860b-4abdae95f105 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:03:44 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:03:44 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:44 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 1073741824 Jul 05 03:03:44 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:45 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 1073741824" returned: 0 in 0.848s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:45 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 Jul 05 03:03:45 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:45 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105" returned: 0 in 0.623s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:45 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:03:45 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48d9f5e-b4a9-4cb7-a69e-a049b3210949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7bab463-0cd7-459a-860b-4abdae95f105', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999dedd9-5cb1-4d4c-b2bd-f828d6afd19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:45 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Volume volume-c7bab463-0cd7-459a-860b-4abdae95f105 (c7bab463-0cd7-459a-860b-4abdae95f105): created successfully Jul 05 03:03:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999dedd9-5cb1-4d4c-b2bd-f828d6afd19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:45 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (53d71daf-7e1f-4693-9ca7-602a164a0d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:03:45 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-99d56165-af85-4fdc-aa0b-871df368697d tempest-ProjectMemberTests-240412322 None] Created volume successfully. Jul 05 03:03:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:46 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Creating offline snapshot 575cb6f1-d2ee-4932-90da-b81343811ba5 of volume c7bab463-0cd7-459a-860b-4abdae95f105 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 03:03:46 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7502ff43-f85b-4a0d-890b-3497ea86325d]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:46 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:46 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 Jul 05 03:03:46 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:47 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105" returned: 0 in 0.757s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:47 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 1G Jul 05 03:03:47 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:47 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 1G" returned: 0 in 0.788s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:47 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7bab463-0cd7-459a-860b-4abdae95f105 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:48 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7bab463-0cd7-459a-860b-4abdae95f105 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 Jul 05 03:03:48 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:48 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7bab463-0cd7-459a-860b-4abdae95f105 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5" returned: 0 in 0.669s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:48 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 is being set with open permissions: ugo+rw Jul 05 03:03:48 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:48 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 Jul 05 03:03:48 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:49 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5" returned: 0 in 0.620s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:49 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.info Jul 05 03:03:49 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:49 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.info" returned: 0 in 0.634s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:49 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.info is being set with open permissions: ugo+rw Jul 05 03:03:49 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:49 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.info Jul 05 03:03:49 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:50 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.info" returned: 0 in 0.639s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:50 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.192s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:50 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-8ae0db5b-751a-4611-8746-fe45293a0207 tempest-ProjectMemberTests-240412322 None] Create snapshot completed successfully Jul 05 03:03:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-575cb6f1-d2ee-4932-90da-b81343811ba5-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Lock "cinder-575cb6f1-d2ee-4932-90da-b81343811ba5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-c7bab463-0cd7-459a-860b-4abdae95f105" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-c7bab463-0cd7-459a-860b-4abdae95f105" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-575cb6f1-d2ee-4932-90da-b81343811ba5" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:51 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-575cb6f1-d2ee-4932-90da-b81343811ba5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Deleting offline snapshot 575cb6f1-d2ee-4932-90da-b81343811ba5 of volume c7bab463-0cd7-459a-860b-4abdae95f105 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 03:03:51 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] snapshot_file for this snap is: volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 03:03:51 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[faebc40e-e4ea-44c2-9aa4-35e695dcbc5b]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:51 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:51 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 Jul 05 03:03:51 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:52 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5" returned: 0 in 0.717s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:52 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7bab463-0cd7-459a-860b-4abdae95f105(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:03:52 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40950ad-cd80-4fb2-a7a9-c5369c46ad44]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:52 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:52 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 Jul 05 03:03:52 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:53 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105" returned: 0 in 0.741s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:53 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 Jul 05 03:03:53 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:53 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5" returned: 0 in 0.734s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:53 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:53 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5 Jul 05 03:03:53 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:54 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105.575cb6f1-d2ee-4932-90da-b81343811ba5" returned: 0 in 0.637s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-575cb6f1-d2ee-4932-90da-b81343811ba5" released by "_delete_snapshot" :: held 2.919s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-c7bab463-0cd7-459a-860b-4abdae95f105" released by "delete_snapshot" :: held 2.940s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Created reservations ['ff7a93e1-6160-481c-b314-7af7d047c7ad', '6ace7ace-a435-400a-a81e-c4fbc789a0df', 'fed99dcd-66ae-441b-ad6e-b1ad42161398', '1dc39e42-f704-48f0-ae08-b3f440475946'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:03:54 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Delete snapshot completed successfully. Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ffce5167-8c86-49c1-8f75-bec1b1d82d6a tempest-ProjectMemberTests-240412322 None] Lock "cinder-575cb6f1-d2ee-4932-90da-b81343811ba5-delete_snapshot" released by "delete_snapshot" :: held 3.073s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-c7bab463-0cd7-459a-860b-4abdae95f105-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Lock "cinder-c7bab463-0cd7-459a-860b-4abdae95f105-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-c7bab463-0cd7-459a-860b-4abdae95f105" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-c7bab463-0cd7-459a-860b-4abdae95f105" acquired by "delete_volume" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[62da6bca-5352-4055-a4c7-fe290cf208de]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:54 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:55 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 Jul 05 03:03:55 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:55 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105" returned: 0 in 0.760s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:55 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:55 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105 Jul 05 03:03:55 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:56 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-c7bab463-0cd7-459a-860b-4abdae95f105" returned: 0 in 0.646s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:56 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-c7bab463-0cd7-459a-860b-4abdae95f105" released by "delete_volume" :: held 1.462s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:56 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Created reservations ['1f932032-d7e9-4692-a480-19a3549a3d37', 'c23247e4-9979-4098-ab9d-68ba8ac44cf1', '4f3b9499-c52a-434d-b1ab-c8967963b3e0', '1cd7293b-2be4-46ed-abc1-0f36a4d4a292'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:03:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:56 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:56 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:56 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:03:56 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:57 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.648s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:03:57 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Deleted volume successfully. Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-158f76c9-4d58-42b6-b5fa-8c8a4de19800 tempest-ProjectMemberTests-240412322 None] Lock "cinder-c7bab463-0cd7-459a-860b-4abdae95f105-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (4c841da2-e689-42da-8e8d-55296e66f408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e868333a-25a8-4f3f-a107-2afa19fb89e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e868333a-25a8-4f3f-a107-2afa19fb89e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483797640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:03:57Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25e3fdc-6ea7-43d1-8dcf-c28bb6b63bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25e3fdc-6ea7-43d1-8dcf-c28bb6b63bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd815940-3090-4046-a151-f52000996805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd815940-3090-4046-a151-f52000996805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5', 'volume_name': 'volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86413842-d378-464f-923f-43d4e60da36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86413842-d378-464f-923f-43d4e60da36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4774671-2172-4899-85c9-eeb73f1f9996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:57 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Volume f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5', 'volume_size': 1} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483797640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:03:57Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Creating volume f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:03:57 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:03:57 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:57 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 1073741824 Jul 05 03:03:57 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:58 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 1073741824" returned: 0 in 0.779s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:58 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 Jul 05 03:03:58 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:03:58 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 05 03:03:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" returned: 0 in 0.620s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:03:58 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:03:58 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:03:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4774671-2172-4899-85c9-eeb73f1f9996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4692218e-903c-42de-a54f-88c7a97b4081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:03:58 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Volume volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 (f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5): created successfully Jul 05 03:03:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4692218e-903c-42de-a54f-88c7a97b4081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:03:58 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (4c841da2-e689-42da-8e8d-55296e66f408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:03:59 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-fea70627-8e16-42b3-82b6-db3ae406b8a6 tempest-ProjectMemberTests-240412322 None] Created volume successfully. Jul 05 03:03:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:03:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:03:59 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Creating offline snapshot bd600262-478e-4b54-979e-85e1044a9520 of volume f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 03:03:59 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[f120319f-a975-4a6e-94da-8bd6272e64d7]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:03:59 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:03:59 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 Jul 05 03:03:59 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:00 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" returned: 0 in 0.731s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:00 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:00 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 1G Jul 05 03:04:00 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:01 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 1G" returned: 0 in 0.764s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:01 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 Jul 05 03:04:01 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:01 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520" returned: 0 in 0.698s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:01 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 is being set with open permissions: ugo+rw Jul 05 03:04:01 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:01 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 Jul 05 03:04:01 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:02 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520" returned: 0 in 0.642s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:02 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:02 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.info Jul 05 03:04:02 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:03 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.info" returned: 0 in 0.635s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:03 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.info is being set with open permissions: ugo+rw Jul 05 03:04:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:03 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.info Jul 05 03:04:03 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:03 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.info" returned: 0 in 0.608s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:03 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.159s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:03 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-5b5afaab-7536-431f-afe1-4acc2f3d5fc0 tempest-ProjectMemberTests-240412322 None] Create snapshot completed successfully Jul 05 03:04:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-bd600262-478e-4b54-979e-85e1044a9520-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Lock "cinder-bd600262-478e-4b54-979e-85e1044a9520-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-bd600262-478e-4b54-979e-85e1044a9520" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:04 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-bd600262-478e-4b54-979e-85e1044a9520" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Deleting offline snapshot bd600262-478e-4b54-979e-85e1044a9520 of volume f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 03:04:04 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] snapshot_file for this snap is: volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 03:04:04 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c4318c-2cb2-433c-830a-90001c957189]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:04 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:05 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 Jul 05 03:04:05 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:05 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:04:05 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:05 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520" returned: 0 in 0.764s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b0862c-2096-4158-aa40-fccf0772c1a1]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:05 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:05 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 Jul 05 03:04:05 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:05 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.629s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:06 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:04:06 devstack cinder-volume[86671]: DEBUG oslo_service.periodic_task [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] Running periodic task VolumeManager._thread_info {{(pid=86671) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 03:04:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread count: 28 {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5545}} Jul 05 03:04:06 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-6e903c80-9380-47b2-8133-854a719bac87 None None] thread info: [<_MainThread(MainThread, started 137073992396928)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86671) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5546}} Jul 05 03:04:06 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" returned: 0 in 0.763s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:06 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:06 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 Jul 05 03:04:06 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:07 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520" returned: 0 in 0.700s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:07 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520 Jul 05 03:04:07 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:07 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:07 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5.bd600262-478e-4b54-979e-85e1044a9520" returned: 0 in 0.611s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-bd600262-478e-4b54-979e-85e1044a9520" released by "_delete_snapshot" :: held 2.926s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" released by "delete_snapshot" :: held 2.946s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:07 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=55,cinder:UPDATE=78,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:04:07 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:UPDATE=59,cinder:SELECT=59,cinder:INSERT=22,cinder:DELETE=11 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:04:07 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Created reservations ['90055a90-7936-4cee-99c6-ff0a3d02723b', '0c7b7ed3-7bc5-4959-bf3a-88464bf62c2e', 'caeceeb5-49ed-40a7-a2d9-ed4084489383', '6e630e11-6224-4e36-ae41-27c546a5a8c0'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:04:07 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Delete snapshot completed successfully. Jul 05 03:04:07 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-7bf69761-5965-4df5-9dd9-89bba67db5aa tempest-ProjectMemberTests-240412322 None] Lock "cinder-bd600262-478e-4b54-979e-85e1044a9520-delete_snapshot" released by "delete_snapshot" :: held 3.075s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Lock "cinder-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:08 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:08 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ec3690-50e5-4386-a5d1-ef85912f15cb]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:08 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 Jul 05 03:04:08 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:08 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" returned: 0 in 0.724s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:08 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:08 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5 Jul 05 03:04:08 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:09 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" returned: 0 in 0.646s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:09 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5" released by "delete_volume" :: held 1.428s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:09 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Created reservations ['7aefff87-cddc-40e3-a1d4-9e0fcc156654', '6b59fdd3-fc5a-43cb-9c56-e84b0957808e', '010940f1-f42a-4c77-ae84-abe7dc7abdc6', '85aa667a-70b8-4972-b4c7-698d627167fa'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:04:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:04:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:04:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:04:09 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:04:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:09 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:09 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:04:09 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:10 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.613s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:04:10 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Deleted volume successfully. Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-4b9cd225-5258-4e53-aaa3-fff0f3f2f1c1 tempest-ProjectMemberTests-240412322 None] Lock "cinder-f709bf0b-1d00-44a1-ab61-0c5b4b9d01a5-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (accd1f2a-3754-4e0e-927f-1af2f5476d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11d87d8-43e7-43b3-a31c-711d4b229d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11d87d8-43e7-43b3-a31c-711d4b229d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1186110498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1794eee-08c7-4ce5-aaf7-c36a043151b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:04:11Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79938da9-a7c2-4f6c-91b9-6582d9246f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79938da9-a7c2-4f6c-91b9-6582d9246f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6ffee3-8fad-474b-bc2b-20ac2c784766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6ffee3-8fad-474b-bc2b-20ac2c784766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1794eee-08c7-4ce5-aaf7-c36a043151b9', 'volume_name': 'volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e25809-c2b9-44d1-bcab-8e1aec096c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e25809-c2b9-44d1-bcab-8e1aec096c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a788cd-7e47-4da8-8c62-af1108ca1742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:10 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Volume f1794eee-08c7-4ce5-aaf7-c36a043151b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9', 'volume_size': 1} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1186110498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1794eee-08c7-4ce5-aaf7-c36a043151b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:04:11Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Creating volume f1794eee-08c7-4ce5-aaf7-c36a043151b9 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:04:10 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:04:10 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:11 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 1073741824 Jul 05 03:04:11 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:11 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 1073741824" returned: 0 in 0.798s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:11 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:11 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 Jul 05 03:04:11 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:12 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9" returned: 0 in 0.639s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:12 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:04:12 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a788cd-7e47-4da8-8c62-af1108ca1742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f35b32e-7d08-4226-8eef-414e50ccf09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:12 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Volume volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 (f1794eee-08c7-4ce5-aaf7-c36a043151b9): created successfully Jul 05 03:04:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f35b32e-7d08-4226-8eef-414e50ccf09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:12 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (accd1f2a-3754-4e0e-927f-1af2f5476d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:04:12 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-1c825920-683d-48f8-9ce4-8908a027c26c tempest-ProjectMemberTests-240412322 None] Created volume successfully. Jul 05 03:04:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:04:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:04:13 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Creating offline snapshot 848a47ca-7048-4186-aba1-4ee840dc2b2b of volume f1794eee-08c7-4ce5-aaf7-c36a043151b9 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 03:04:13 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c05d42-c33f-4b49-b19a-fc85a9995948]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:13 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 Jul 05 03:04:13 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:13 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9" returned: 0 in 0.743s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:13 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:13 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b 1G Jul 05 03:04:13 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:14 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b 1G" returned: 0 in 0.764s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:14 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:14 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b Jul 05 03:04:14 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:15 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b" returned: 0 in 0.675s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:15 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b is being set with open permissions: ugo+rw Jul 05 03:04:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:15 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b Jul 05 03:04:15 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:15 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:15 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b" returned: 0 in 0.644s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:16 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.info Jul 05 03:04:16 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:16 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.info" returned: 0 in 0.628s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:16 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.info is being set with open permissions: ugo+rw Jul 05 03:04:16 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:16 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.info Jul 05 03:04:16 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:17 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.info" returned: 0 in 0.611s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:17 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.142s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:17 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-f216820c-20c7-4684-99aa-93b198455f13 tempest-ProjectMemberTests-240412322 None] Create snapshot completed successfully Jul 05 03:04:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-848a47ca-7048-4186-aba1-4ee840dc2b2b-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Lock "cinder-848a47ca-7048-4186-aba1-4ee840dc2b2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-f1794eee-08c7-4ce5-aaf7-c36a043151b9" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f1794eee-08c7-4ce5-aaf7-c36a043151b9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-848a47ca-7048-4186-aba1-4ee840dc2b2b" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:18 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-848a47ca-7048-4186-aba1-4ee840dc2b2b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Deleting offline snapshot 848a47ca-7048-4186-aba1-4ee840dc2b2b of volume f1794eee-08c7-4ce5-aaf7-c36a043151b9 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 03:04:18 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] snapshot_file for this snap is: volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 03:04:18 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fae8137-4255-4e4f-a9e1-f1c95215b3f6]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:18 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:18 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b Jul 05 03:04:18 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:19 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b" returned: 0 in 0.716s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:19 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:04:19 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[80392733-50bc-41e6-acd4-5af0fdbe88c9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:19 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:19 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 Jul 05 03:04:19 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:20 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9" returned: 0 in 0.729s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:20 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b Jul 05 03:04:20 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:20 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b" returned: 0 in 0.734s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:20 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:20 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b Jul 05 03:04:20 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:21 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9.848a47ca-7048-4186-aba1-4ee840dc2b2b" returned: 0 in 0.626s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-848a47ca-7048-4186-aba1-4ee840dc2b2b" released by "_delete_snapshot" :: held 2.888s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f1794eee-08c7-4ce5-aaf7-c36a043151b9" released by "delete_snapshot" :: held 2.914s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Created reservations ['2b0fb6a3-c8b1-453c-ab04-f3b90f14678d', '3b1533e5-678f-498a-b1e2-43b903cc0de2', '451e790b-e859-4540-8330-9d6c4609f896', '70ec7878-3be4-4a26-a551-a73ee113df79'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:04:21 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Delete snapshot completed successfully. Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-ff61f27e-e014-4312-8c58-0b02f5a044d6 tempest-ProjectMemberTests-240412322 None] Lock "cinder-848a47ca-7048-4186-aba1-4ee840dc2b2b-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-f1794eee-08c7-4ce5-aaf7-c36a043151b9-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Lock "cinder-f1794eee-08c7-4ce5-aaf7-c36a043151b9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-f1794eee-08c7-4ce5-aaf7-c36a043151b9" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f1794eee-08c7-4ce5-aaf7-c36a043151b9" acquired by "delete_volume" :: waited 0.015s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[5770ddd1-c4a7-4e0b-85ca-758206a75db9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:21 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:21 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 Jul 05 03:04:21 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:22 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9" returned: 0 in 0.740s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:22 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:22 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9 Jul 05 03:04:22 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:23 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-f1794eee-08c7-4ce5-aaf7-c36a043151b9" returned: 0 in 0.619s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-f1794eee-08c7-4ce5-aaf7-c36a043151b9" released by "delete_volume" :: held 1.413s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Created reservations ['a0e1dc34-95dc-484f-9732-294e9def2992', 'd762c283-8618-4f8f-9e30-a26dcdcc108b', 'c9763daa-bddf-4b3d-8d6f-c20b441a768d', '2719de60-40eb-42f1-9a79-66eda2818b5f'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:23 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:04:23 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:23 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.616s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:04:23 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Deleted volume successfully. Jul 05 03:04:23 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-12da3fde-f970-4af7-a6c6-8283603b7c7a tempest-ProjectMemberTests-240412322 None] Lock "cinder-f1794eee-08c7-4ce5-aaf7-c36a043151b9-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.flows.manager.create_volume [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86671) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (942c0a04-5771-4236-be4d-974c9f82af4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1484e1-25f8-4aad-8c99-62fce47dc9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1484e1-25f8-4aad-8c99-62fce47dc9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-288050536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e584df4-febc-45c3-991b-59dc742f0333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:04:24Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d334128-d01b-4728-a54a-6d4153a84318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d334128-d01b-4728-a54a-6d4153a84318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188cb15e-3df3-4eb1-a60d-055d75b39daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188cb15e-3df3-4eb1-a60d-055d75b39daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e584df4-febc-45c3-991b-59dc742f0333', 'volume_name': 'volume-7e584df4-febc-45c3-991b-59dc742f0333', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082ae9c8-1d80-4634-a017-eb6fa1808113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082ae9c8-1d80-4634-a017-eb6fa1808113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3005947-9bd1-4d34-bf3e-8b57230e9e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:24 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Volume 7e584df4-febc-45c3-991b-59dc742f0333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e584df4-febc-45c3-991b-59dc742f0333', 'volume_size': 1} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T01:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-288050536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e584df4-febc-45c3-991b-59dc742f0333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16b5523c35243278262e619d35360df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T01:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T01:04:24Z,use_quota=True,user_id='ad2d755bdd4e4b5a9c523c8e11a9e47d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3705d7b6-1894-47a0-8cd4-74b4adf9763c),volume_type_id=3705d7b6-1894-47a0-8cd4-74b4adf9763c)}" {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Creating volume 7e584df4-febc-45c3-991b-59dc742f0333 {{(pid=86671) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Selected osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e as target Quobyte volume. {{(pid=86671) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 03:04:24 devstack cinder-volume[86671]: INFO cinder.volume.drivers.remotefs [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] casted to osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e Jul 05 03:04:24 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 1073741824 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:24 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 1073741824 Jul 05 03:04:24 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:25 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 1073741824" returned: 0 in 0.780s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:25 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 Jul 05 03:04:25 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:25 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333" returned: 0 in 0.627s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:25 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'} {{(pid=86671) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 03:04:25 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3005947-9bd1-4d34-bf3e-8b57230e9e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e584df4-febc-45c3-991b-59dc742f0333', 'volume_size': 1}' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76027b0e-f614-4f67-bd34-5dcc727225e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 03:04:25 devstack cinder-volume[86671]: INFO cinder.volume.flows.manager.create_volume [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Volume volume-7e584df4-febc-45c3-991b-59dc742f0333 (7e584df4-febc-45c3-991b-59dc742f0333): created successfully Jul 05 03:04:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76027b0e-f614-4f67-bd34-5dcc727225e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86671) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 03:04:25 devstack cinder-volume[86671]: DEBUG cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Flow 'volume_create_manager' (942c0a04-5771-4236-be4d-974c9f82af4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86671) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 03:04:25 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-d321ab8b-c57c-4335-aeb1-5d48ad1db744 tempest-ProjectMemberTests-240412322 None] Created volume successfully. Jul 05 03:04:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:04:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:04:26 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Creating offline snapshot 29ca98d8-58be-42b4-953d-34a235657f46 of volume 7e584df4-febc-45c3-991b-59dc742f0333 {{(pid=86671) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 03:04:26 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[81528723-6c7d-48fb-a85c-e61bd49b2fd3]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:26 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:26 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 Jul 05 03:04:26 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:27 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333" returned: 0 in 0.732s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:27 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 1G {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:27 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 1G Jul 05 03:04:27 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:28 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 1G" returned: 0 in 0.761s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e584df4-febc-45c3-991b-59dc742f0333 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:28 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e584df4-febc-45c3-991b-59dc742f0333 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 Jul 05 03:04:28 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:28 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e584df4-febc-45c3-991b-59dc742f0333 -F qcow2 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46" returned: 0 in 0.667s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:28 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 is being set with open permissions: ugo+rw Jul 05 03:04:28 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:28 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 Jul 05 03:04:28 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:29 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46" returned: 0 in 0.626s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:29 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.info Jul 05 03:04:29 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:29 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.info" returned: 0 in 0.625s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:29 devstack cinder-volume[86671]: WARNING cinder.volume.drivers.remotefs [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.info is being set with open permissions: ugo+rw Jul 05 03:04:29 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.info {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:29 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.info Jul 05 03:04:29 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:30 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.info" returned: 0 in 0.618s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:30 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.118s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:30 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-87832ee2-e044-4f4b-9d8d-ad088d6c0d71 tempest-ProjectMemberTests-240412322 None] Create snapshot completed successfully Jul 05 03:04:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-29ca98d8-58be-42b4-953d-34a235657f46-delete_snapshot" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Lock "cinder-29ca98d8-58be-42b4-953d-34a235657f46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-7e584df4-febc-45c3-991b-59dc742f0333" by "delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-7e584df4-febc-45c3-991b-59dc742f0333" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-29ca98d8-58be-42b4-953d-34a235657f46" by "_delete_snapshot" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:31 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-29ca98d8-58be-42b4-953d-34a235657f46" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Deleting offline snapshot 29ca98d8-58be-42b4-953d-34a235657f46 of volume 7e584df4-febc-45c3-991b-59dc742f0333 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 03:04:31 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] snapshot_file for this snap is: volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 {{(pid=86671) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 03:04:31 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2cdeed-f3fb-487d-9c70-b363600be8d9]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:31 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:31 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 Jul 05 03:04:31 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:32 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46" returned: 0 in 0.746s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:32 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.remotefs [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e584df4-febc-45c3-991b-59dc742f0333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86671) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 03:04:32 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e4576-a76f-4ee1-8cbf-52e8640f8bcb]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:32 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:32 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 Jul 05 03:04:32 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:33 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333" returned: 0 in 0.736s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:33 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:33 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 Jul 05 03:04:33 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:34 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46" returned: 0 in 0.695s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:34 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46 Jul 05 03:04:34 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:34 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:34 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333.29ca98d8-58be-42b4-953d-34a235657f46" returned: 0 in 0.636s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-29ca98d8-58be-42b4-953d-34a235657f46" released by "_delete_snapshot" :: held 2.895s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-7e584df4-febc-45c3-991b-59dc742f0333" released by "delete_snapshot" :: held 2.915s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:34 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Created reservations ['5694a504-551a-4ba7-8236-06264726761c', '9f5f9414-8f2b-4172-a6db-71e0b04ee7aa', '68b773aa-0c84-4aae-a057-76ea4abda17d', '3582afb5-0846-4a4b-985d-5c7a7ddd1529'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:04:34 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Delete snapshot completed successfully. Jul 05 03:04:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-a886608e-b68e-4666-9f6e-772eae16225d tempest-ProjectMemberTests-240412322 None] Lock "cinder-29ca98d8-58be-42b4-953d-34a235657f46-delete_snapshot" released by "delete_snapshot" :: held 3.041s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:34 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-7e584df4-febc-45c3-991b-59dc742f0333-delete_volume" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Lock "cinder-7e584df4-febc-45c3-991b-59dc742f0333-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Acquiring lock "cinder-quobyte-7e584df4-febc-45c3-991b-59dc742f0333" by "delete_volume" {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 03:04:35 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-7e584df4-febc-45c3-991b-59dc742f0333" acquired by "delete_volume" :: waited 0.016s {{(pid=86671) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 03:04:35 devstack cinder-volume[86671]: DEBUG oslo.privsep.daemon [-] privsep: reply[426351b3-cfff-4df1-accb-993a267f6370]: (4, 'qcow2') {{(pid=87648) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 03:04:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:35 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 Jul 05 03:04:35 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:35 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333" returned: 0 in 0.756s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:35 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:35 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333 Jul 05 03:04:35 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:36 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a/volume-7e584df4-febc-45c3-991b-59dc742f0333" returned: 0 in 0.631s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:36 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Lock "cinder-quobyte-7e584df4-febc-45c3-991b-59dc742f0333" released by "delete_volume" :: held 1.440s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:36 devstack cinder-volume[86671]: DEBUG cinder.quota [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Created reservations ['dcb07bec-2b99-4c9a-9811-a0913382de16', '8dfc4473-2bcf-4279-84fd-77bcefa08496', '142808f4-4796-4a7b-9d12-031e50223434', 'ab432342-4f02-4306-9ad8-2f38f8dd60af'] {{(pid=86671) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 03:04:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 03:04:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 03:04:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e': None} {{(pid=86671) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 03:04:36 devstack cinder-volume[86671]: DEBUG cinder.volume.drivers.quobyte [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-16e49147-38c1-4b79-8268-de386b21643e'] {{(pid=86671) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 03:04:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.lockutils [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86671) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 03:04:36 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 03:04:36 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a Jul 05 03:04:36 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 03:04:37 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 05 03:04:37 devstack cinder-volume[86671]: DEBUG oslo_concurrency.processutils [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f95ac2086b7e0d127fb5239fbd50029a" returned: 0 in 0.646s {{(pid=86671) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 03:04:37 devstack cinder-volume[86671]: DEBUG cinder.manager [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Notifying Schedulers of capabilities ... {{(pid=86671) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 03:04:37 devstack cinder-volume[86671]: INFO cinder.volume.manager [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Deleted volume successfully. Jul 05 03:04:37 devstack cinder-volume[86671]: DEBUG cinder.coordination [None req-dbc27682-281d-4a84-84c8-4274bef17eb9 tempest-ProjectMemberTests-240412322 None] Lock "cinder-7e584df4-febc-45c3-991b-59dc742f0333-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=86671) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 03:04:46 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=38,cinder:INSERT=14,cinder:UPDATE=50,cinder:DELETE=4 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 03:04:47 devstack cinder-volume[86671]: DEBUG dbcounter [-] [86671] Writing DB stats cinder:SELECT=35,cinder:INSERT=14,cinder:UPDATE=49,cinder:DELETE=3 {{(pid=86671) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}